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ABSTRACT 

The report describes an experimental study involving 1 
an on-line placement system in Boulder, Colorado which permitted 
applicants to request information from a terminal on any job stored ^ 
in the computer. Data were collected on applicants referred by the. 
Employment Service: whether or not hired, reason for not being hired 
if not hired, applicant characteristics, and job characteristics^ A 
telephone follow-up, made appro'ximately 150 days after placemep^, 
determined tenure on the job, wage rate, hours worked, reason^ for 
termination, and date of termination when applicable. Appli^sfants who 
were referred as a result of a computerized job search had/^ a better 
chance of finding jobs,, stayed on the job longer, and ea^ed more 
money than applicants referred through self-service microfiche 
readers. There was not evidence, however, that the coiaputer increased 
ttie chances of placement or duration on jobs over those achieWd by 
manual applicant searches for special target groups^/ Speed of/ ^ 
retrieval and consequent cost decreases fav,or the computer search , 
procedure over the manual. With better applicant and job de^criptprs, 
the system could likely be improved. Nearly 50 pages of appendix^^s 
provide an abridged version of the users* guide, referra^^ status file 
descriptors, and regressions* (Author/JR) 
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Ihis report is available in two volumes. Volume I describes an on- 

ine job matching experiment in Boulder, Colorado, which collected 
information on placements, referrals and duration of jobs referred 
by an on-line system versus other means. Volume II describes the 
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ABSTRACT 

r 

A computer terminal was installed in Boulder, Colorado. It was 
connected to the University of Michigan computer in Ann Arbor. Before 
the experiment, * jobs received by the Employment Service statewide had 
been sent to Denver each evening and conver^ied to microfiche for dis- 
tribution to local offices. The experiment permitted applicants to 
request information from a terminal on any job stored on the computer. 
Job orders for permanent jobs received by' the local office resulted in 
a search against the applicant file. Applicant cards were- pulled from 
a manual file and further screened. 

Data were collected on applicants referred by the Employment 
Service: whether or not hired, reason for no hire if not hired, 
applicant characteristics, and job characteristics. A telephone ' * 
follow-up, made approximately 100 days after placement, determined 
tenure on the job, wage rate, hduifs worked, reason for termination if- 
the applicant was no longer working, and date of ' termination. 

Applicants who were referred as a result of a search of computerized 
applicant files had a better chance of finding, jobs, stayed on the iob 
longer and earned more money than applicants referred through self- 
service microfiche readers. However, applicants referred -throwgh manual 
applicant search and walk-in applicants who saw an employment officer, 
also had a better chance of being placed ^han did applicants who were 
referred through the self-service use of microfiche. 

Applicants referred by computer or manual employer search stayed on 
the job longer than applicants referred by other methods such as self- 
service and job development. However, manual applicant searches were - 
done only for special target groups such as veterans that were given ' 
special priority. Therefore, there is no evidence that the computer 
increased the chances of placement or 'duration on jobs over those 
achieved by manual applicant search. 

Speed of retrieval appears to' be the main advantage of the computer 
over manual applicant search. If the computer holds adequate information, 
a computer applicant search can be carried out in seconds. A manual 
search takes 15-20 minutes. 
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Use of the computer to make job searches was expected to be an 
Important advantage of an on-line system. Applicants -would be given 
a computer search if they had trouble locating a job in the immediate 
area or if they wanted to search on criteria other than their exact 
occupational codes. However, very few applicants were placed in this 
manner. Not a single job search resulted in a job in the Denver area, 
only an hour's drive from Boulder. 

^ It is possible that the computed would make more difference in 
bpth applicant and job searches in a large city like New York or 
Los Angeles, where manual methods would be much more costly. It is 
also possible that if better applicant and job descriptors were pro- 
vided, a computer system would make more difference. Finally, a 
computer can be helpful in a counseling situation even if it doesn't 
lead to a placement. 

In the computer simulation described in Volume II, an office with 
an oit-line computer system ^as modeled to permit simulated Allocations 
of employees and machines. Volume II demonstrates that simulation can 
be a useful planning tool for local Employment Service office managers. 
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CHAPTER ONE 
MAJOR FINDINGS 

An experimental computer assisted job-applicai>t matching system 
installed in Boulder, Colorado, highlighted some of the benefi^ and 
limitations of computerized job matching. (A chapter reference is 
given for each finding. All ^references are to Volume I unless "^other- 
wise noted. ) 

1) It is feasible to transmit data from a data communication 
computer in one state to a central computer ±n a remote state such as 

a regional office. The primary advantage oi such -a configuration would 
be to minimize software costs, not to open up job orders to a wider 
clientele. During the experiment not a single applicant found a job in 
Denver using the conqjuter. The computer was used as a device to screen 
jobs that met the applicants' specified criteria. Denver was one hour 
away from Boulder. (Chs. 2 and^5) 

2) Two different modes of computer search were used in the experi-^ 
^ment. In the first mode a, search of the job file was made for an appli- 
cant. In the second mode a search of the applicant file was made 
against a given job order^ The first mode was used infrequently and 

^when used had little impact on improving the probability of placement. 
The second mode was used for every permanent job order and significantly 
increased the probability that the applicant chosen would find a job 
compared to 'applicants selecting their own job from self-service micro- 
fiche. (Chs. 2 and 3) 

3) In Salt Lake City very little use is made of the computer ter- 
minal for actual job matching. Most job matching' occurs when an appli- 
cant finds his own job posted on the board or if th^ computer matches 
an applicant against a job order in the evening. (Vol. 11^ Ch, 5) 

4) The benefit of the computer terminal for job matching depends 
critically on the size of the applicant job files.. It is possible that 
in a large 'city such as New York or Los Angeles the computer can be 
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beneficial for both helping applicants that come into the office 
searching for a job as well as searching for applicants when a job , 
order arrives, 

5) The Dictionary of Occupational Titles (DOT) was used as the 
primary search code searches against applicant files. This code 
proved to be an inadequate descriptor, necessitating Manual screening • 
of applicant cards. A better search field would be a descriptor based 
language such as DECAL currently being developed by tHfe. Department of ^ 
Labor, only 20 percent of the placements made had identical applicant ' 
and job DOTV-. (Ch. 2) 

6) During the experiment' the Boulder local office referred the 
n^jority of their applicants through use of self-service microfiche 
This method was supposed to cut down on employment officer time and 
hence increase productivity. However, the ratio of placements to 
referrals was so low with this method (io%) that while employment ' 
officers spent less time servicing each transaction they had to service ' 
.more transactions. Employers had to see more applicants before they 
found a suitable applicant. These factors probably led to a drop i. 
job orders placed in the Boulder office, sharper than at other Employ- 
ment Offices in the state. (Ch. 3) . ' - 

7) It was originally thought that there would be significant 
differences in placement rates between centralized mode and individual- 
ized mode, m centralized mode a single terminal operator does the job 
search for an applicant seeking a job. In individualized mode e^ch 
employment officer does his own" search. Ho.wever. so few job searches 
were done by employment officers for clients in the- office that the 
differences in placement, rate by. mode could not be tested. (Ch. 3) 

8) Inability to locate applicants matched by the computer for a ^ 
given job was a major ptoblem. A suggestion made but not tried was to 
assign applicants a unique code knd record this on a telephone recorded 
message. Applicants could call the recording any evening. If their " * 
numbers were recorded and they appeared the next morning at the office 
they could be screened and given first preference for a, job referral 
Applicants not matched would be given a lower priority on referrals. (Ch 3) 



9) The use of the terminal eliminated the need to preset rigid' 
criteria for applicant search. If the terminal operator di^ not find 
anyc applicants she could often slightly ..change the criteria until a 
suitjable applicant was found. This appears to be an intrigul^ng area 
for further 'experimentation, (Ch. 3) 

10) There was a definite learning effect in computer placements. 
As the terminal operator became more experienced, the placement rate 
increased. However, an economic downturn in the economy offset the 
learning effect toward the end of the experimental period, leading to 
a decline in the placement rate. (Ch. . 

11) A multiple regression model was developed to predict the 
probability that a given applicant using a given method of referral 
would find a given job. The njodel for example predicted a probability 
of near zero for a white college student using self-service mode to 
find a permanent job in a professional occupation requiring experience. 
The probability was near 1 for a .Spanish, applicant called in August or 
September, 1975, as a result of a i^nual search in a benchwbrk or struc 
tural occupation for a part-time job requiring only basic literacy • 
(Ch. 3) 

12) In most employment offices, employment officers searching 
files or microfiche to help applicants find jobs or find applicants for 
a given job could do as good or a better job as the computer in a local 
office the size of Boulder as measured by probability that a job 
referral would result in a placement. (Ch. 3) However, the computer ' 
can do the search faster. If each state had to make a major investment 
in new software to. make job matching possible, it is unlikely that the 
job matching would be cost effective. However, if job matching can be 
done through regional centers or if software is developed centrally and 
distributed to each, state, the matching systems can be cost effective. 
(Ch. 5) • / ^ " * 

13) The computer cajt provide many new seryices to employers and 
applicants in addition to, job matching, such as customized job order 
taking for employers. With customized brder .taking, the computer <ian 
recall information about previous orders,, saving the employer time. in 



describing job duties and saving the order taker time in writing up 
orders. Much more detail can he stored about jobs than would he 
possible under existing arrangements. The computer can restore the 
personalized touch by recalling information about the employer.' 

14) A contiguous wage history of. persons employed in Colorado was 
used to determine wages and tenure on the job of applicants placed by 
the Employment Service, A telephone follow-up supplemented information 
collected from' the wage history. Tenure information was obtained on 
85% of the placements. Persons placed by computer and manual search 
were employ^'d the longest and received the highest aggregate wage during 
Che period fi-om placement to follow-up. (Ch. 4) 

15) A simulation can be an effective tool for a local office 
manager to use to evaluate the effect of different configuration on 
client flow. (Vol. II) 

The foregoing conclusions were based on a pilot study in Boulder.. 
The findings may not of course hold true for all Employment Service 
offices: Limitations of the study are discussed in Chapter Six. 
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CHAPTER TWO 
BACKGROUND 

♦ 

The United States Employment Service has automated the placement 
of applicants through computerized job matching in selected areas^ 
The Utah Employment Service developed the first State Job Matching 
system; other matphing systems have been developed for New York, 
"Milwaukee, and California. The California system was shut down, 
howevej, due to lack of resources. Plans for matching systems are 
un^Jezrway ^in other states. 

Most evaluations of matching systems have been limited. They 
have been primarily concerned with data on 'placements beforehand after 
the system was initiated and have failed to isolate other factors which 
may have contributed to increases or decreases in placements. 

This study has been developed an aid to policy makers concerned 
with the relative benefits and costs of on-line systems. Its purpose 
has been to analyze the usefulness of such systeids, but its -techniques 
have far wider applicability. Other manpower programs could be evaluated 
by modifying the various models described in this paper. 



Previous Research 



The study is a continuation of a project which was started in 1970 
and funded by the Manpower Administration to develop prototype labor 
market information systems. One o£ several by-products of the earlier 
study was a prototype inf ormation-storage-and-retrieval system called 
MICRO that can be used by employment officers to match applicants to 
jobs or vice versa. 1 MICRO was used in the current experiment*. 



IPor a complete d^rscription of this project, see the final report by 
Malcolm S. CoherJ, On the Feasibility of a Labor and Information System , 
Institute of lab)^ and Industrial Relations, University of Michigan- 
Wayne State University, Ann Arbor, 1974, 3 Vblumes. 
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In the earlier study, a terminal was in i/^iiarily counseling 



In. that context, 
evaluation was 



iltiation to aid counselors in helping yoLfc| jfind jobs, 
^he c\nselors felt the terminal was ia usL^l' jid. ' Tha 

ised upon subjective evidence; i.e.,i thjUuns.elors' oiinions. In a 
,cciunseling situation, an applicant can of^^n be helped without being 
placed if he is counseled to go back to slool or lo change career lines. 

' Purpose of Study { 

The purpose of the current study is to |ie ^objective evidence such 
as data on referrals, placements ,* and ten'ureloli ^he job in a full- 
^service local office environment rather thL |i L office whose primary 
objective is youth services and counseling A 4^ Boulder, Colorado, 
local office was selected by the Denver RegionV Office of" the Manpower 
Administration and the State of Colorado Div\si|i of Employment as the 
site for this experiment, 



Organization of Report 

Chapter 3 discusses the results of compariLnl between computer- 
assisted placement of applicants and placement bV ^her means. 

Chapter 4 discusses a follow-up study carrieV.out by the Colorado" 
Division of Employment. Employers were contacted by telephone three to 
four months after placement to determine the employiient status or termi- 
nation (Jate of each applicant. Since the Colorado Division of Employ- *, 
ment maintains v/age records on most persons employed in the state, it was 
'possible to compare the quarterly wages of those placed by computer-^ 
assisted methods with those placed by other means. ' ' 

Chapter 5 discusses 'the costs, benefits and design of an optional 
matching system. 

Chapter 6 summarizes some limitations of the study. 

Description of Experiment 

An on-line placement system was installed in the Boulder, Colorado, 
office of the Employment Service. Tjie system included one terminal with 
access to the University of Michigan computer in Ann Arbor. Nightly 
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transmission of applicant and Job Bank data made possible an up-to-date 
data base. Card images were transmit^ted from a Mohawk Data Systems 
key-to-disk computer to* the University of Michigan's IBM System 36^/67 
In Ann Arbor. All Job Bank data received by the state for inclusion in 
the next day's Job Bank microfiche distribution was transmitted to 
Ann Arbor; the transmission included applicant characteristic and 
referral data recorded by the loc^l office in the preceding two to three 
days. This delay was part of the normal Colorado Emplo3nnent Service 
operating procedure. 

Each Employment Service office in the state Was receiving microfiche 
copies of the state's job orders. Separate microfiche listings were 
available at the Boulder office for the Boulder-Longmont area, the rest 
of the metropolitan Denver area, and the rest of the state. Thus, an 
applicant might have had to search several microfiche listings in looking 
for a job. 

The State of Colorado Division of Employment and the Department of 
Labor Regional Office selected the Boulder office f6r the experiment . 
because it ^as expected to be stable during the experimental period. . 
Chapter 6 des^ibes some limitation^ of the site. 

The on-line system tested in Boulder involved^ no new forms and 
required virtually no •programfaiig by the Colorado Division of Employment. 
For the most part, it used existing Employment Service data. 

The design and operation of an optinfal matching system for Colorado 
would co&t several million dollars over a 3-to-A year period. Such a 
system is described in Chapter 5. The optimal matching system would use 
descriptors for both applicants and jobs. Codes from the Dictionary of 
Occupational Titles were*, used to describe apj)licants an^ jobs in this 
experiment. 2 ^ . * 

In the experiment, job drders, descriptions and job titles were 

coded in free form English and could be"^ retrieved. Job titles or jolf 

descriptions x:ould be accessed, by a key word or any part of a key word; 

i.e.; Engl , for English * In this example, the computer would retrieve 
* » 

T 4 ' " ~— 

2U.S. Department of Labor, Dictionary og Occv^pational Titles , Third 
Edition.- , 
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all orders containing any words starting with " Engl /' 
Research Issues 

The major research questions the Boulder experiment dealt with 
were the ways in which placement rates, percentages* of referrals not 
qualified, numbers of placements, wage rates and retention rates^' 
differed among different modes of placement, Modes used in the 
experiment included the following: 

1) Search of computer applicant*" f ile by termitxal operator 
usifig the computer terminal as a job order- is received, 

2) On-line search of job file for an applicant who talked in. 

3) Self service using special job listings prepared on the 
computer terminal ,. but which could have been prepared in 
batch mode. The listings were organized by whether experi- 
ence was required on the job. Within each experience group 
the listing was organized by occupational code '(DOT). - 

4) Job development by an employment officer, 
doyment officer referral of walk-iil applicant to 'jobs 
which employment officer was aware. 

• 6) Employment officer searcfh using microfiche to help" an 
applicant find a job. 
7) Self service using microfiche. The microfiche were 
organized by office and occupational code (DOT). 

0) Manual applicant search leading to the applicant being 
called in. 

Other research questions of interest are listed below. 

1) On a selected hasis, applicants who had difficulty finding , 

jobs in Boulder were told that they could be given a computer 

search of any jobs in. the state. How many placements were 

made in Denver, a one-hour drive from Boulder, as a result of 

computer Job searches? 

' 2) Two m,odes of terminal operation were possible: injdivi dualized 

« 

mode and centralized mode. In individualized mode, each 

, employment officer personally used the terminal for job 

*^ ^ 

^For a discMssion of retention rates see Chapter 4. 

• 4 
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searches* In centralized mode, one person did all job searches 
For-»the entire office* What factors made one mode of operation 
more attractive or feasible than the other? 

3) ^In order to assess the relevance of search criteria, it is 

useful to compare the descriptors of the applicant placed in 
a jqb vith the descriptors listed in the job order. The 
Colorado manual system uses occupation codes for primary 
occupational classifications. When job DOT codes were com- 

m 

pared with applicant DOT codes, how many Actually matched? 

4) How did placements in the Boulder local office compare with 
those in other local offices during tfhe period of the 
experiment? 

5^ The Institute of^^Labor and Industrial Relations has developed 
a prototype information system, MICRO. MICRO allows users 
to ask English-like questions about data stored in the 
computer. Under what circumstances was this retrieval tool 
useful in, j ob^ placement? 

6) Which demographic characteristics increased the probability 
of pl'acenjent success? 

7) What were the characteristics , of hard-to-place applicants in 
the sample? - ^ . - ' 

A ivumber of dother ra^earph issues - the methodology for selecting 
the optimal number of terminals, the ratio of emplojrment officers and 
receptionists to terminals In the individualized mode, and the optimal 
number of microfiche readers were considered.^. They are addressed in the 
simulation experiment described in Volume 2. 

MICRO Inforroation^Stgyage^ and. Retrieval System 

Employment officers were able to make use of the MICRO Information . 
Storage and Retrieval System developed by the Institute of Labor and 
Indystrial Relatiorfs.^ The MICRO system allows Employment Service 

^Two volumes are available which describe the system: Michael A. Kahn, 
Donald L. Rimelhart and Boyd L. Bronson, MICRO Information Retrieval 
System MICRO Training Manual > and Technical Refer.ence Manual s the 
Institute of Labor and Industrial Relations,* University of Michigan- 
Wayne State University? Ann Arbor, Michigan. 
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personnel to ask^the computer structured questions in an English-like 
language without the intervention of a programer. For example, an 
applicant may have vished to consider only those jobs in Denver County 
paying over $5.00 an hour in a certain occupation. T.o make such a 
request to the computer, an analyst could say "FIND IN JOBS WHERE MIN- ' 
PAY>5.00 AND DOT IS 013156 AND COUNTY IS DENVER." 

Data Files . 

As a result of the experiment, four major data files (exclusive of 
the data described in Chapter 4) were created: 

1) Applicant Data File 

2) Job Data File * ' 

3) Job Description Data File 

4) Referral Status Data File 

. The Applicant Data File contained characteristics of applicants 
registered in^ the Boulder office and was searched every time that office 
received a job order. App^dix A contains a list of fields found in the 
Applicant Data File. 

The Job Data File contained summary codes about every job in the 
statewide Job Bank and was accessible to Employment officers wishing 
to aid applicants searching 'for. a particular job. See Appendix A for 
a list of fields in the Job Data File. 

The Job Description File contained descriptions of jobs In free 
form English. These descriptions-were part of the standard Job Bank 
system. Queries, about the data stored in this file were made by 
searching for a key word or part of a key word. Descriptions could 
be printed out for any job order selected. - See Appendix A for hypo- ' 
thetical job descriptions. 

The Referral Status Data File was primarily used to evaluate the 
computer experiment. It could also be^ use^ by the manager of an 
Employment Service local office ior evaluating local office performance 
or for employer "development. Tne file contained information on each 
referral mide by the Boulder office. This information included data 
on the job, applicant, date of referral, and date of placement. When 
no placement was possible, it listed causes; i.e., "not qualified" or 
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"another applicant selected." See Appendix B. for the file description. 

The experimental period ran from July 1 through October 30, ,1975, 
although data was collected before and after the experiment. Prior to 
the experimental period, ar training session was given. A user's manual 
was prepared and is excerpted in Appendix A.^ 

Activity in the Local Office Before the Experiment 

For many years ^ the Boulder office kept statistics on placement 
transactions, which are shown in Figure 1. A notable yearly increase 
in placements from 1970 to 1973 is followed by a decline in 1974. 

" A moHel w^s developed to relate placement transactions" in Boulder 
to trend changes, seasonal factors and economic conditions in the 
Boulder-Denver^ labor market areia* This model makes it possible to 
explore the question whether or not the 1974 decline in placements 
can fee explained by the decline in the business cycle and whether the 
months selected for the experiment are typical or atypical in terms 
of number of placements. 

The model we developed follows: 

Pt = Bo + BiURt + B2 JANUARY. . . B12NOVEMBER 

where Pt is the number of placement transactions in a 

given-Tiremth ^ 

ITRt is the unemployment rate in the Boulder-Denyer SMSA 

measured on a residence basis for the month- 

JANUARY = 1 in January; 0 otherwise 

FEBRUARY =^'1 in February; 0 otherwise 

ETC. 

' Coefficients and t statistics estimated from the model are shown 
in Table 1. The t statistics measure the statistical significance of 
a variable. It is accepted with a 95 petcenr probability that a 
variable with a t greater than 2 is signific^tly different from 0. 
The dummy variables, January to Nqvember, measure the difference 
expected in placements between any given month and December with the 

^The availability of the reference and technical manual is discussed in 
footnote 4. 

■ 11 * ' 
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1. COEFFICIENTS AND t STATISTICS ESTIMATED FROM ^PUCEMENT EQUATION 
DEPENDENT VARIABLE - NUMBER OF PLACEMENTS ~ 



Variable 


Coefficient 


t Statistic 


Constant 


1185 


8.7 


UR 


e 

-191 


-6.6 


Januar^^ 


58 


0.8 


Feb ruairy 


-51 


-0.7 


March 


24 


0.3 


April 


60 


0.8 


May- 


'150 


2.0 


June 


210 


* 

3.0 


July 


55 


0.8 


August 


33 


0.5 


September 


113 


1.6 


October 


131 


1.9 


November 


65 


0.9 


R^ = .65 


SE = 109.24 





I 
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unemployment rate held constant. For example, the coefficient for 
June was 210, indicating thatr other things being constant, June 
placements are 210 above December placements. December was the low 
month of the year. According to our model. May. June. September and 
October were the highest placement months. A time trend originally 
Included in the model was found to be insignificant. 

The unemployment rate in 1974 increased by one-half of one percent, 
implying a decline in placements of about 100 a month, which is exactly 
what happened. 

Although these conclusions make sense, they are tentative because 
they are based on an insufficient number of . observations over the full 
range of the business cycle.. Unfortunately, unemployment data for 
Denver before 1970 are not available in a form consistent with current 
data. The use of this fnodel to infer the effect of terminal-assisted 
placement would be unwarranted. The unemployment rate was higher 
during 1974 than in any other year since 1970, and other important 
changes had been made in the local office. During April 1974, self- 
service micrbfiche readers were installed; the combined effect of the 
self-service microfiche readers and the terminal canriot be separated * 
With a, time series analysis. However, the analysis in Chapter 3 does 
. separate the effects of the two operations . 

This example demonstrates the difficulty of using b6fore-and-af ter 
placement data as a lone evaluation tool. Had job matching been , 
installed at the end of 1970. results of a time series analysis would 
be totally misleading unless it included adjustments for chaftges in 
the area's unemployment rate*. 

During the period from April 1, 1974, through June 30, 1974, prior 
to'the experiment, there were 442 placements at the Boulder office. in 
permanent jobs. There were over 1100 placements in one- to three-day 
Jobs . The remaining 220 placements were either from, four to 150 days 
'or over 150 days, but only for a day or so a week or as needed. 

The placement/referral rate for casual or intermittent jobs is not 
meaningful because the Employment Service acted as the hiring agent. 
The employer usually hired any person the ES selectjed. The gtatistics 
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show a 99 percent placement/referral rate', but a referral/ was often not 
recorded if the applicant was not hired. 

For jobs of a non-casual and non-intermittent nature the placement/ 
referral rate is of greater interest. Of 2925 referrals made, only 15 
percent resulted in hires. The reasons given by employers for not hiring 
workers are shown in Table 2. ; 

TABLE 2. APPLICANTS NOT HIRED - REASONS FOR NO HIRE 



I 1 

Applicant refused job 4l 1.40 

Failed to report for interview 456 15.56 

Failed to report for work 32 1.09 

Job filled , 707 24.17 

Applicant not qualified- " * 1127 38.53 

Applicant failed test 1 .03 

Another applicant selected 116 3.97 

2480 84.75 



By far the most common reason was the applicant's lack of qualifi- 
cations. 

Before the computer was installed, employment officers would search 
applicant cards filed by Dictionary of Occupational Titles (DOT) groups. 
If tiie DOT codes were stiff icient job and applicant descriptors, a high 
degree of match between the applicants' DOT code and the ^ DOT code of 
the jobs in which they were placed could be expected. 

The DOT code used by the Colorado Employment Service consists of 
six digits. The first digit identifies the broad occupational job 
family of the occupation; e.g., prof essional,- managerial or service. 
The first two digits narrow the job title to broad occupational groups;* 
e.g., engineers or clericals. The third digit narrows the job further. 
The last three digits pinpoint ^worker traits required in the job; e.g., 
ability to deal with people, things or data. Only 20 percent of appli- 
' cants hired we^re placed in jobs where their six-digit DOT code was 
identical to the job DOT code. About 25 percent of applicants hired 
matched on a three-digit cpde. One third of applicants matched on the 
first two digits. Half of the applicants matched on the first digit 
only . 

15 
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Table 3 illustrates the crossover between the occupations applicants 
were classified in, and the jobs they found. Applicants shown outside, 
of the boxes worked in occup'ations other than the ones in which ^hey 
were classified. Crossover is largest for applicants in managerial 
occupations. One factor accounting for considerable crossover is the 
similarity between unskilie<?* occupations classified under different 
major occupation codes such as benchwork laborers,, structural work 
laborers, miscellaneous laborers, etc. All laborers have the same last 
three digits of the, DOT code. Almost one-fourth of those -DOT.'s not 
matching on the first digit matched on the last Lhree digits. 

The remaining non-matches were predominantly in low-experience 
jobs. About 60 percent'ol the non-matching jobs required no experience. 
Another 27 percent required only one to six months of experience, but 
this is typical bf most Employment Service jobs in Boulder. 

A low percentage of minority group and poorly educated applicants 
failed to find jobs. An analysis was undertaken of applicants who were 
referred to three or more permanent jobs and who wer^ not hired during 
April-August 1975. The analysis showed that out of 165 such applicants, 
only nine had completed less -than 12 years of school, only two were 
Spanish Amer^icans and only one was Black. 

The local office had a mandate to provide service to veterans. 
About one-quarter of all applicants placed in permanent jobs during ^ 
1974 were veterans.' 
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^ TABLE 3. PERCENTAGE OF CROSS OVER MATRIX 

OCCUPATION OF APPLICANT VBRSOS OCCUPATION OF JJOB 

SECOND OIIARTKP. 1974 
BOULDER LOCAL OFFICE 



Occupation 
of Applicant 


0 12 3 


Occupation of Job 
4 5 6 7 8 


9 


rr, 


N 1 ifnK o Y* 


Professional 


0 


|40 20 






5 


20 




5 




90 


Managerial 


1- 


frST- 18 24 


12 


6 




6 


12 


6 


100% 


1 7 

J. / 


Clerical J sales 


<> 
2 


2 (25] 22 


2 


0 


2 


13 


3 


4 


1005^ 


69 


Service 


3 


~ 3 jm 








12 


1 


4 


100% 


72 


Fanning 


4 




* 








* 




100% 


6 


Processing 


5 








* 


• * 


c 




100% 


2 1 


Machine trade 


6 


* * 


* 




* 


* 


* 




100% 


14 


Bench work 


7 


4 10 








ED 


7 


13 


100% 




Structural work 


8 


3 12 - 


4 


» 


4 


16 


m 


9 


100% 


90 


Misc. 


9 


7 33 


5 


4 




,10 


21 


Eil 


100% 


.57 
402 



1 



Percentages do not add to lOO due to rouyiding* 

*Under 15 applicants in occupation, so allocation is not shown. 

Table excludes place^ments for student Summer jobs. These students ' 
are assigned a special. DOT code. Crossover would not be a ineaningful> 

concept for this group. 

>. •» 
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CHAPTER THREE 
BOULDER EXPERIMENTS 



Placement Success Search Modes 

In this section, applicants referred through the use of a computjsr 
terminal are contrasted with applj.cants referred through other placement 
methods. Additional research ^issues' ^re discussed. The job ..retention 
of applicants placed by computer terminal, versus those placed by other 
meatis is the subject of Chapter 4*' ^ 

During the experimental period, July 1, 1974"- October 31, 1974, 
several different modes of placement were used in the Boulder local 



office: 




1) 


On-line search ^of applicant file. 


2) 


On-line search of job file. 


'3) 


Self-service via midrof i'che. 


4) 


Self-service via computer print-out. 


. 5) 


-Employjaent Office use of microfiches 


6) 


Job development . 


7) 


Applicant walk-in. 


8)-. 


Ap pli cant call-in . * ^ 



.1. On-line Computerized Search of Applicant File 

For every long-term job order received by the Boulder office, a 
computer-aided search of the applicant file was initiated by a central 
terminal operator; preference was given to veterans during .this process. 
Applicant searches were usually made soon after an order came in; the 
order would appear on microfiche put out by the Colorado Division of 
Employment for state-wide distribution the following day. 

Once an applicant search was completed, the terminal operator 
manually pulled those applicants* hard-copy, characteristic cards. 
An employment officer screened the applicant cards, and the terminal 
operator called in the applicants the employment pfficer selected. 
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There was room for Improvement in several of the procedures 
followed in the local office. 

First, it would have been desirable to completely eliminate the 
manual cards and replace them witK on-line information. Since the - 
experiment was scheduled .to end i- a relatively short time, two 
parallel systems had to be maintained. Many clerical tasks - filing, 
searching, and indexing cards; reactivating old applications; and 
purging inactive applications - could have been eliminated by auto- 
mating the manual file. 

Second, the computerized version of the applicant card contained 
only the information already keypunched in Denver for reporting pur- 
poses plus a limited amount of extra information for matching purposes. 
This compromise was necessary; otherwise the local office would have 
had three parallel systems in operation — the manual file, the 
Michigan computer file, and the state reporting *file. The information 
added for matching included the number of mohths of experience of the 
applicant in the .occupation of lliT^Ol^ code, his willingness to go to 
Denver, and his minimum acceptable' pay . Appendix A illustrates the 
information available on applicants. 

The information most frequently examined on the manual cards and 
not found in the computer included descriptions of fche applicant's 
previous, work history and the type '^of work for which he was qualified. 
For exalnple,- one administrative assistant position might have required 
mainly bookkeeping skills ; another writing skills; a third, administra- 
tive skills; and a fourth; ^typing skills. One secretarial job might 
have required typing at 60 vterds per minute; another, shorthand 
experience. The. Ideal system x-7ould have had multiple occupation codes 
to indicate the range of jobs for which each applicant could qualify. 

Third, many of the applicants did not list phone numbers on their 
application cards. Noncomputerized placement in the Boulder office 
largely depended upon the applicant being in the- office early enough 
each day to see if there was a job offered that interested him and 
for, which he was qualified. 

- . 19 
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Use of the computer could lead to procedural changes that would 
improve the placement process, reduce applicant trips to the local 
office and lead to a better match between referred applicants and • 
jobs. One such procedure would assign each appllcatif an identifying 
number. Epch night, the applicants who had been matched with jobs 
that day b.ut who had not been reached by^ telephone' would be able to 
learn of the jobs by calling a central operator or recording. It ^ 
was riot possible to institute such a procedure during the experikent 
because of its short duration. Many applicant/job matches did not 
lead to referrals or placement^ because the applicant could not be 
reached before the job was removed ^rom the Job Bank, 

Fourth, the applicant search pro(^s proved to be a learning 
experience for the central terminal operator, a clerk with some prior 
Employment Service experience in Unemployment Insurance. She was not 
an emplpyment officer; but by the end of the experiment, she was 
knowledgeable enough to search *f or applicants on the basis of worker 
trait groups such as 887 for laborer. She could use the '^'dat'a," ^ i 
"people" or "things" codes which identified proficiency in working 
vlth data, people or things. % 

Fifth, the experiment illustrated how an on-line system can be 
used effectively for applicant' search. The terminal operator was 
able to exercise some judgmental control over the matching process 
by varying the criteria used to select applicants for jobs- and by 
|r finding applicants for difficult orders. For many routine job orders, 

however, batch matching might be adequate, 

2, On-line Search of Job File 

Before the start of the experiment, it was thought- that the most 
important component of an on-line match system in a typical local office 
was the use of the terminal to help walk-in applicants find jobs. The 
findings in Boulder led to a'n almost completely opposite conclusion. 
Only in very special circumstances is an on-line job search useful for 
helping applicants find jobs. Explanations of c some of these circum- 
stances follow, 

20 
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1) An applicant'^ aspirations are inconsistent with the labor 
market. For example, the on-line system was used to show applicants 
that more education was necessary to obtain their desired salary. 
For example, one appl^Lc^nt wanted a job as an administrative assistant. 
The system printed 28 jobs for administrative assistants at or above 
his stated minimum jiay on the terminal. Three of these jobs were open 
. to persons without college degrees and those riquired some highly 
. technical skill, suchias a proficiency in two languages. This parti- 
\ cular applicant was .cbunseled to return to school and complete on6 more 
year of college. He was not placed through the use of the computer 
terminal; but h^ was aided. . ' . ' 

2) An applicant ^is willing to move or commute. A manual se^ch 
• of^many areas would take a long time. The computer can perform a 

. search which would otherwise be very time consuming. However, 
Employment Service clients seem likely to want to do very little 
commuting or: mo-\^ng. * 

In the four months of the experiment, not a single job search • 

Resulted in the placement of an applicant in Denver", even though Denver 
is lessvthan 60 miles from Boulder and a very pleasant ride. It may 
be that Boulder's attractive -location deters people frOm sacriricing • 
pleasant Surroundings for income. 

3) A large labor market, such as Los Angeles or New York, iliay 
have 'so many job openings that applicants cannot examine them all 
intelligently witTiout mechanical assistance. 

Salt Lake City, Utah, -had an on-line job- matching system in 
operation; but walk-in applicants 'received very lit tie help with job 
searches by terminal. ■ The majority of applicants used display boards 
listing various jobs arranged by occupational group. 

4) An automated matching system can do a better job of searching 
applicants and for job orders than can be done manually. The Boulder 
experiment did not adequately , test what an ideal placpment system can 
dp, although its on-line job searches for walk-in applicants did use 
free fbtm English key wor'ds ih job descriptions and titles, numerous 
categorical- descriptors, and occupation co^es from the Dictionary of 



Occupational Titles ; thus, even an ideal match system *would be un likely 

- to significantly improve on-line matching for those applicants who just 

walk into the local office, although tatch matching of jobs and appli- 

• •• 
cants could be significantly improved,. In most instances an on-line 

matching system cannot be justified solely on the grounds that it per- 
forms well in finding an applicant a job when he is in the local office. 
However, the computer performs other functions which mi-ght justify its 
use. 

'3.- Self-service Microfiche 

Every night, ^a 11 jobs^ on the Employment Service statewide Job Bank 
were updated, put on microfiche, and sent to each local office of the 
Employment Service by special messenger before 8 a.m. the next morning. 
Applicants finding a job on the microfiche through self-service codk 
the job^s control number to employment interviewer who called the 
Denver Job Bank central control for permission to refer. Employment 
interviewers were supposed to do lome screening. The number of appli- 
cants they saw and the number of applicants designated not qualified 
by employers raises some doubt about how much screening they did. 

4. Self-servica Printout 

Microfiche available in the Boulder local office were* organized 
in Dictionary of Occupational Titles (DOT) code order^. Even though 
applicants knew their own DOT's, they did not know which other DOT's 
might be alternative occupations. Five copies of an alternative 
listing iwere printed every morning on the computer terminal. This 
listing was organized into two groups: jobs requiring experience 
and jobs requiring no experience. Within each group, the jobs w^re 
in DOT^order. The listings were limited to Boulder area jobs. 

The availability of the listing resulted in two services to 
applicants. The first made more copies of the job listings available; . 
it saved time spent waiting in line for the microfiche reader. The 
second service made it easier for an applicant to search through job 
listings. ' ■ * - 
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The .al„ purpose of o„-u.e access tc the co^uter „as to locate 
Ob for a person by carrying out a number of alternative searches 
using various criteria. If the'se criteria are general for a large 
group of applicants and can be specified In advance, ' then several 

allTle":""""'^ """" " ' — 
access unnecessary. 

» 5- Employment Officer - Microfiche 

:n.e instances In vhich a. applicant received help finding a Job 
fro. the employment of fleer who used his s.Ul to help the eppllc nt 
search the microfiche were recorded. ' ^ _ c 

6. ' Job Development . * 

If kn. applicant „as a veteran or deslgnatid for special services 
.n attempt „as made- to develop a Job for hl«. Job development „as the 
only situation In „hlch the employment officer tal.ed directly to tL 
employer before sending the applicant to hip. Ihe'refoVe, a higher 
Placement/referral ratio for Job development referrals ™uld h! ' 
expected than In the self-service referrals mode. 

Applicant Ballf-<, ^' ■ . 

In some Instances. „!,en an applicant walked Into- the office an 
employment officer knew of a Job possibility. For e.at.ple. If a' 
meteorologist walked into the ofti;6e looking, for a Job, an employment 
Officer might send him to the National Center on Atmospheric Research 
(HCM) . some c^loyers had .greed to cooperate with the Employment 
Service m hiring veterans, and a veteran „ho walked In might be sent 
to such an employer. In these cases, referral was donel personally 
.without the use of the on-line system or the microfiche' reader. 

Applicant Call-in ^ 

Baployment .officers rarely did manual searches for applicants 
unless an employer had agreed to a special arrangement benefiting some 
target group, such as veterans. «hen this happened, the employment 
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officer could go through the manual file and pick out suitable appll-^ 
cants, but usually he called in applicants he knew instead of , searching 
the manual ifles. Most of these applicants came from the employment 
officer^s caseload. 

^Results of Experiment 

Table 4 stmmiarizes the number of placements made during the 

experiment by different modes, the placement /referral ratio, number 

If 

of placements, and referrals found not qualified by the employer. 
The two modes of placement with the highest placement rates are appli- 
cant walk-in and manual applicant search. 

The manual applicant search category is quite misleading. One 
firm accounts for 30 of the 84 placements, this ^imf hsd 31 referrals 
^nd 30 placements. It was willing to hire veterans on a 90-day 
contract; and when the employment officer in charge of veterans was ^ 
unable to obtain a permanent placement f o^ ^a veteran, he could send 
the worker to the firm on the 90-day basis. If applicant searches 
. had been done* routinely rather than only for veterans in a caseload 
situation, the placement rate might have been about .4-. 5 in this 
office. However, the cost of manual applicant searches is* very high; 
a search could take anywhere from 15 minutes to two hours depending 
on the nature of the job order. Searches were done in very special 
circumstances only. 

The walk-in category also had a placement rate of over .5. This 
category includes circumstances in which an employment^ off icer knew of 
a job possibility when an applicant who met the job qualifications 
walked in. In some instances, the job was listed oh the microfiche. 
In other instances. It was not. In these circumstances, there was 
usually something special about the applicant that increased his 
chances of being placed 'in this way. Only 27 such referrals were 
made in 4 months. 

The employment officer-microfiche category included the active 
participation' of both the applicant and employment officer in job 
searches. In this instfarice, the emplojnnent officer was also screening 
the applicant more carefully. Here the placement ratio was .3. 



TABLE 4. PLACEMENT BY DIFFERENT METHODS 
BOULDER/ COLORADO 7/1/74-10/31/74 



Method* 


Referrals 


Placements- 


Placement 
Rate^ 


J^Cl. CL Lei JL 

Fraction 
Not Oiifll -f f-f 


!• 


On-line Search of 
Applicant File 


150 


' 29 


.19 




. .35^ 


2. 


On-line Search of 
Job Pile 


131 


17 


.13 


:29 


3. 


Self-Service 
» Microfiche 


2282 


243 


.10 


' .29 


4. 


Self-Service 
Printout 


550 


57 


.10 


.39 


5- 


Employment Officer- 
Microfiche 


339 


103 


.30 


.26 




Job Development 


142 ^ 


28 


.19 


.38 


1. 


Applicant Walk-In 


27 


" 14 


.51 


.14 


8. 


Manual Applicant 
Search 


129 


85 


.65 


.13 




All Methods 


3750 


576 


.154 


.30 



*A sta^tistlcal analysis of variance technique sWed the variable 
method' to be highly significant at the .0001 level. -The-F 
statistic was 50. *This explained 10% of the variation in the 
placement rate. 
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The two lowest cate gories In terms of placement ratio success 

were both self-service: only 10 percent of these refertals resulted 
in placements. 

Surprisingly, the computer did only slightly better than self- 
service in job search for applicauus. However, the compoiter was only 
used In this connection if a special problem arose or if the applicant 
^ was willing to move or commute outside of Boulder. There were never 
. more than 200 jobs listed on the microfiche for the Boulder area. When 
this list was further subdivided into occupational categories, the 
number of jobs an applicant needed to look at was smali. For^ example^ 
a person wanting a clerical job could limit the nxamber of jobs to 30 
or 40. Little would have been learned and much time wasted using the 
computer when it was not needed, ^ 

If an applicant wanted a job paying over $5.00/hour or a job any- 
where in the state, he might have had to look at 1000 jobs to detennine 
which, if any, met his criteria. In this Instance the computer could 
be very useful » 

It is interesting to note, however, that not. a single on-line job 
search resulted in a placement in Denver* During the four months in 
^question, 23 placements of all types made from Boulder were recorded 
as in Denver,, 4 percent of all placements » However, some of the 23 
placements may have been employers with branch offices in Boulder. 
Therefore, some of the 23 so-called Denver placements may have ieen 
Boulder placements. 

There were two types of on-line job searches. One was done when 
the applicant was present. The other was done in his absence by* 
.pulling his card from the manual file. The first activity accounted , 
for only five placements but resulted in a placement referral rate of 
.18. The second activity accounted^for 12 placements but had a place- 
. ment referral ratio only slightly higher than that of self-service. 
If the optimal matching system described in Chapter 5 were implemented, 
the second ratio would probably be much higher. 

Applicant searches in response to each job order had the highest 
placement -referral rate of the on-line placement categories. It 
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accounted for the greatest number of on-line placements, 24. The 
placement ratio was double that of self-service.' 

Employment .'service personnel found applicant computer search to 
be so valuable^ that they were most upset when the experiment ended 
and the service ended. Computer search could reduce the burden ' 
placed upon employers ^nd applicants by preventing referrals when 
the probability of placement is very low. 

Not Qualified , 

Another interesting aspect of Table 4 is the referral fraction 
of those not qualified. Both types of self-ser^^ice had', the same 
placement rate (.10). The two types of self-service were microfiche 
and printout. The microfiche listing arranged jobs by occupational 
code for Jobs 'listed at th^ Boulder office. The printout .grouped 
Boulder jobs requiring experience separately from Boulder groups 
requiring no experience. Within each experience group, the jobs 
'were arranged by occupation code (DOT) . ' 

Self-service printout referrals resulted in a higher fraction of 
jobs that applicants found not qualified than self-service microfiche 
^ referrals... We hypothesize that this is due to either: " 

1) The groupings "experienced" and "inexperienced" might 
have encouraged applicants to seek jobs for which they 
were not qualified; or' 

2) Applicants using microfiche might have been timid about 
searching for jobs outsfde their DOT's, especially if 
there was a line waiting to use the microfiche readers . • 

. Applicants using computer listings probably wouldn't be 
as harassed. 

The high fraction of applicants not qualified on applicant searches 
is attributable to inadequate "descriptors stored in the computer. 
Chapter 5 proposes an adequate system." 

Experience 

Another significant factor affecting the placement ratio^is 
whether or not the job required experience. Table 4 does not show 

27 ■ 

' . ■. . . 36 ■■ - ' .. 



(d 
u 
u 



O 



0) 



o 
5S 



cd 

Q) 



0) 
0) 

o 
cd 



o 

•H 

M 

a 

w 



0) 

o 

•H 

o 

S5 



U 

Q) 
•H 
M 



Q) 
O 

Q) 
•H 
M 

a 
o 



0) 

a 
c 

0) 



Q) 
O 

Q) 
•H 

o 

525 



CO 

o 



H 



H 
CO 



CM 



00 



in 



o 



00 
CM 



VO 

oo 



CM 
CO 
CM 



00 

3' 



1^ 



00 



O 



CM 



0\ 



CO 



CO 
CO 



CO 



o 

CM 



CO 

CM 



CO 



oo 

04 



oo 

CO 



in 



CO 



o 



CM 



o 



o 
<o 



CM iH 

m CO 



CM 
00 















0 


o , 








0) 










O rH 


o 








M •H 




Q) 


Q) 




(d 


cd 


O 


a 




0) 


0) 






0 


CO 4J 


cn 


> 


> 




a 


Q) 


H o 


U 4J 




0) (d 




0) •H 




0)* 


a o 




CO »W 


CO o 




•H 




1 0 


1 4J 








^ M 






1 Cu 




iH a 


H •H 










0) M 




O < 


o »-> 


CO X 


CO 






CM 


CO 





4J 

o u 



0) 

o 

•H 

O 



O S 



4J 

a 

0) 

o 









4J 


0) 








§; 


(d a 




(d 




0 M 








*H i 




•H O 




iH ^ 




iH U 




PUrH 




p. td 


0 


PU Cd 












<J CO 


• 


• 


• 








00 











•O 






*H 






4J 






Cd 


CO 






1 i 






fj 




n 


Q) 




% 






4J 


3 








*H 


4J 


(d 


M*l 






*H 


a 


Pu 


rH 






(d 


0) 








•H 




o 


00 


<U 


4J 




0 




•H 




CO 


<U 




0) 


iH 




(0 






Cd 


CO 




u 


Q) 


0 




V4 


*w 


o 


CO 


CO 




H 






(d 


(d 












H 




Q) 


Q) 




*W 


*W 




Q) 


Q) 




U 


^ 


4-1 








*w 




0) 


0 


0 


•H 






O 






•H 


0 


0 




•H 


•H 


»A 


4J 


U 


D 


O 


O 


CO 


(d 


(d 








H 








(d 





differences between jobs requiring experience and jobs requiring no 
experience. Table 5 presents this breakdown. In every instance, 
jobs requiring experience had a lower placement rate than jobs 
^ requiring no experience except referral by self-service printout, 
whete the referral rate was the same whether jobs required experienc 
or not. The higher placement' rate on jobs requiring no experience, 
is understandable for several reasons: * 

1) Jobs requiring no experience also require less skill. 
They are lower paying, and ' employers have lower hiring 
standards. 

4 ^ 

2) Employers requiring experience must de'tennine if the 
applicant has relevanp experience. This is one more 
area in which J:he employer could disagree with the^ 

: .applicant and the employment officer regarding employee ' 

qualifications. 

If one limi&B the comparison of placement success aaong the 
various methods to ^obs requiring experience, omitting manual appli- 
cant search because it was done only in certaih very special circum- 
stances, ^the placement rate varied from .09 to .17. Placement was 
highest for employment officer use of microfiche for job search and 
computer applicant search and lowest for self-s6rvice applicant 'use 
of microfiche or computer listings. . - 

With regard to the proportion of applicants not qualified, in 
almost every instance,' jobs requiring experience had a higher propor- 
tion not qualified than jobs requiring no experience. The only 
exception was computer job' search, where the reverse was true. 

In terms of the merits of a computer sys'tem, one could weigh 
the following cost savings: 

1) Reduced time for Employment Service staff to do applicant 
searches as job orders come in. 

2) Reduced time required 'by employment officers to help 
applicants search microfiche. 

_ 3) Increased productivity of counselors.' 
^ 4) Reduced applicant job-searching time. 
5) Reduced employer time interviewing unqualified applicants. 
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The Boulder experiment makes the following activities appear to 
be less important than otigiially expected. 

1) Give applicants wider flexibility about geographic area^^. ' 
^ ♦ 2) Give applicants who come into the office a better way to | 
search the available jobs. ^ j . 

Individualized Versus Centralized Mode . " 

One interesting question posed at the beginning of the experiment 
was the conditions under which two modes of terminal operation 
individualized and centralized ~ would be- advantageous fir job "place- 
ment. 

Under centralized mode, a single terminal operator makes job 
searches for applicants possible at the direction of the employment 
officers. Under individualized mode, each employment officer makes 
his or her own job searches using the terminal. 

The most important factor affecting the usefulness of individual- 
ized mode is the amount of time spent by the employment officer in 
job searches for applicants. ' In the Boulder' local office, this time 
was virtually nil, Applicants selected their own job orders by micro- 
fiche readers. Applicants vera matched against job orders by computer^ 
but this activity can most readily be performed in centralized mode 
since order taking is centralized. 

Centralized mode was the only feasible mode in the Boulder local 
office^ It had many advantages : -> 

1) Only one person had to be , trained, although employment 
officers did receive initial training; 

2) Only one computer terminal was required. 

3) Individual employment officers did not have to interrupt 
their routines; they could glan^!e. at computer output on 
their desks . 

Originally, it was hoped that the experiment could operate in both 
centralized and individua^lized modes for on-line job searches. However 
there were so few placements made in centralized mode that no conclu- 
sions about centralized versus individualizedjnddes could have been ' 
drawn with any degree of statistical reliability had the original desig 
been followed. ' ' 
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There were many more placements resulting from on-line' applicant 
searches than on-line job searches. It would have been.statisticalir 

^, possible to t;est the difference in placement rates between centralized 
and individualized modes for applicant searches, but individualized 
mode made absolutely no sense for applicant searches. Job orders 

I taken centrally A and ap'plicant searches were best done on-line by one 

^ person as the .job\ order came in. 

! ' In a counseling situation where- a great deal of employment 
officer time is spe^^t helping applicants find jobs, the advantages ' 
of individualized mod^^ could be' weighed against the cost. 

Comparing Boulder's Exp erience to Other. Local Qffir'^« 

Part of the original design called for the activities in Boulder 
to be contrasted with thos.e in other local offices in Denver and in a 
central local office to determine if placements during the experiment 
increased or decreased relative to other local offices. 

Such a contrast would be useful if the computer system was the 
only thing that changed in the Boulder offices during the experiment. 
However, the Boulder local manager left, the assistant manager left,' 
self-service microfiche readers were installed, and a new emphasis ' 
was placed on veteran placement. 

In the long run, a computer matching system might lead employers 
to Increase their use of the Employment Se^rvice if they felt the ' 
.system gave them better service. Such a result couldn't possibly be 
expected to occur in four months. Even if it were possible, it 
wouldn't prove very much if the halo effect caused utilization, to 
drop after the "new gimmick" wore off a year later. 

There was no halo effect in this experiment; no publicity on the 
experimental system was given to employers because it was scheduled 
to be removed after the brief experiment was over. 

Table 6 compares Boulder's placement experience during the 
periods July 1, 1974 - October 31, 1974, and July 1, 1973 - 
October 31, 1973, with the experience of -some other local offices in 
the state. Of most interest is the decline in non agricultural place- 
ments over 150 days in the offices shown in Table 7. 
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TABLE 7. PLACEMENT CHANGE IN 1973-1974 

' • Office ' ^^^"^^ ^" Nonagri cultural Jobs Over 150 Days 
• (July 1 - October 31) 

' ^""^"^ -16.3% " . 

Fort Collins ' 

Brighton . ^ . ' 5^ ; 

^""^"^^ S . --41.0%' 

Source: . Table 6 ' ' 

Declines were experienced in all offices, but 'primarily in Boulder 
and in Brighton. In Brighton, however,, the number of over- three-day 
• placements actually increased due to a tremendous increase in place- 

' inents 4-150 days in length. Boulder's total placements decline by 
, only about 20 percent if one counts applicants for all jobs regardless 
of duration. The declines in Boulder could be attributable to the 
. . • frustratl.on of employers and applicants at the large' number of referrals 
. necessary, to make a placement via the self-service mode as well as the 
economy . 

' Another interesting comparison between Boulder and Denver is the ' 
average placement rate on long-term jobs between the two areas. The 
, data in-Table 6 do not address this issue: They show the number of ^ 
individuals referred and the number of individuals placed. An indi- 
vidual going to 20 job interviews would be counted only once as a 
• referral. The data in- Table 6 are appropriate for answering.questions 
about the effectiveness of service in different offices but not for ' 
comparing different placement methods. It was also n^ce^saryto 
obtain data on transactions in Denver and Boulder from July 1, 1974 - 
October 31, 1974. 

Boulder accounted for 1361 no^agricultural referrals compared « 
^ to -4215 in Denver. Virtually all placements made in Boulder 

on jobs of less than 150 days were eltl^r made with one referral 
or were recorded that way. Assuming" the same was true dn Denver " 
the number of referrals made to jobs lasting 150 days or more can \ " 
be computed by subtracting the 369 placements mad'e in Boulder in ' 
>' . ' ' • ' ~ . , ■ . ' ' ' . 
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jobs under 150 days and the 799 made in Denver in jobs under 150 
days from total placements. Since theye were 162 placements in 
Boulder in jobs over 150 day& and 762 in Denver, we obtain a 
placement rate of .16 in Boulder and ^.22 in Denver. If the more 
coii5>lete data for Boulder had been used to compute the rate in 
prder to validate^ the assumptions made, the placement rate 
would have been .155., This suggests that 'as far as referrals 
to long-term jobs are concerned, Boulder has had a poorer place- 
ment/referral record but one not greatly different 'from Denver's. 



Computer Placements - Learning Effect 

In .Chapter 2, it was hypothesized that on-line placements would 
increase as the central terminal operator became more familiar with 
the procedures. A display of placements by half-month periods is 
shown in Table 8. 

TABEE 8. PLACEMENTS BY HALF' MONTH 
July " October, 1974 





Period 


Computer 
Placements 


Total 
Placements 


Ratio 


Half Month 


1 


'1 . 


S9 


.02 


• Half Month 


2. 


4 


49 ' ■ 


.08 


Half Month 


3 


5 


93 


.05 


Half Month 


4 


11 


99 


.11 


Half Month 


5' 


3 


57 • 


.06 


Half Month 


, 6'^ 


11 ' ' 


111 


.10 


Half Month 


7 


8 


67 


.13' 


Half Month 


"8 ' 


3 


41 


.08 






< 46 


576 


.13 



During the first four half months, computer placements increased 
in every half month. Half-ionth 5 resulted in a sharp decline,^ but 
total placements also declined sharply during this period. In addition, 
the office was closed for Labor Day. Finally, terminal and computer 
problems were frequent during this period. Similarly in half-month 
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8, total placements declined as well as computer placements," 
-^reflecting decreased activity in the' office during this period. 
Another interesting comparison, the placement/referral ratio /is 
shown in Table 9. 

TABLE- 9. COMPUTER REFERRAL AND PLACEMENTS BY HALF MONTH 
July - October, 1974 





Computer 


Computer 




Period 


•Placements 


Referrals 


Ratio 


1 


1 


28 


.04 


2 


4 


38 


■ .lb 


3 


5 


46 


.10 


•4 


11 


72 


.15 


S 


3 


17 


.18 


6- 


11 


27 


.■40 


7' 


8 


34 


.24 


8 


3 


■ 19 


.16 



- The change in the on-line placement/referral ratio reflects two- 
factors. The first factor is the learning- effect which led the 
. ratio to increase every 'period from 1 to 6 despite fluctuations in 
labor market conditions. The d'ecline during periods. 7 and 8 reflects 
the general decline in labor market conditions, which* is evidenced 
by the decline, in total placements during this period. ' During bad 
times, the placement/referral ratio is lower than in good times.'* 
The decline in the on-line placement referral rate in the" last 
month is proportional to- the decline in total placements in the office. 

5 • 

Other Fact ors Affecting Placement 

Tables are not a convenient way of displaying the multi4)le 
factors that affect placement success. Tlrst, tables summarizing the 
effect of several factots -would take many pages -and would be 
difficult to interpret. Second, the entries would be too thin to 
permit valid interpretation of many of the effects. 

. Multiple regression analysis is an alternative approach: 



several factors can be Introduced simultaneously and their separate 
effects can be measured. 

In the multiple regression model, the dependent variable had 
a value of 1 if the referral resulted in a placement and 0 other- 
wise. This variable is known as a dxjimny variable, and the equation 
can be interpreted as a probability or discriminant f unction. 1 

The coefficients can be interpreted as Indicating the effect 
each factor has on the probabijity of a given applicant being 
hired. Table 10 presents the findings. To interpret Table 10, 
consider the variable, permanent job. The coefficient is .-,12, 
which represents the difference in the probability of a referral 
resulting'" in a placement between a permanent and temporary job. The 
t ^statistics for the variables all indicate that the coefficients' 
are statistically significant except for on-line job search-, on ' 
which there Were 'too few observations to measure placement rates. 

Whites had a more difficult time getting jobs than nonwhites, < 
probably 'because both the Employment Service and employet^s dis- 
criminated in reverse for the small number of nonwhites in the area. 
Applicants with Spanish sur^tpies likewise had a higher probability 
of employment. 

Permanent jobs resulted in a lower placement rate than non- 
permanent jobs because both applicants and employers were fussier 
with permanent applicants. Jobs requiring experience took more 
careful screening. Th^ more educated an applicant, the less likely 
he was to find a job on a given referral, both because of the 
nature of jobs listed V the ES and because of the aspirations of 
college students and graduates. ^ 

■ . i 1 _^ 

^Econometric problems arise •in these Junctions if least squares approach 
is used to estimate the model beca^use the least squares assumption of 
homoscedasticity is untenable. An alternative procedure is to use 
generalized least squares. However, our primary interest is in the 
coefficients since there is no bias in the estimation of the co- 
efficients. Even though the standard errors are probably overstated, 
least squares is used. See Cohen, Lerman, Rea, A Micro Model of Labor 
Su££l2:, U-S. Dept. of Labor, BLS Staff Paper 4, 1970 p. 193 for a 
more complete explanation- , 
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IJ^I^^r^ ■ . • ''. TABLE lb. MULTIPLE REGRESSION 



0 



hi. 



Model Predicting Probability 
•A Particular Referral Will 



Sfer.wv.' Result in a Placement 



Variable . ' Coefficient t Statistic 

l|:Kv :' * Constant « - o-i ^ , 

f^%';:'''^r>^' Method of Refer ral 

On-line search of j-ob file 
On-line search of applicant file 
- development 
J^ . ' Walk in ' 42 

ES Officer us^d fiche . .18 



Call in based on manual 
search 



•11 4.0 
•08 2.9 
6.4 
9.0 



•50 16.1 



-•03 ^1,8 



(Self-seirvice = .00) 
Occupation 
Clerical 

Professional-managerial .^07 -2 8 

* Benchwork-structural ,04 2 8 

(All others^ = .00) - 

Pefmanent job ' • -,12 " -54 
Education , / 

Job required some college -,07 -5.4 

Job requires high school grad -.03 -1 7 

(Job requires only basic literacy = .00) 

Job requires experience ' ^ -.05 -.39 

'Applicant^has Spanish surname .06 ^ 2.0 

Kx. / Applicant is white -.06 -1.8 

Referral in August or September ,04 3.7 



IPg^; **Variabae not even significant at .10 level. 




2 

R « .147 SE = .33 n = 3750 




^ On-line applicant searches raised the. probability of job searches 
resulting in placements by ,11 oyer self --service. Applicants' who were 
lucky enough ^to receive special attention, possibly because they were 
veterans or in a high demand area or knew the employment off icers or ' 
were.in a target group, had a much higher probability (betwep .42 and 
• 50) of obtaining a job than applicants who found a job' through self- 
service. These applicants were referred through manual searches or 
were told about a job when they walked in'. 

The employment officer using the microfiche increased the 
'prqbability of placement by .18 over seif-servlce. ' 

Applicants applying in August or September high employment 
months ~ had a probability of the referral resulting in a placement 
•04 higher than applicants applying in July or October. 2 

Regression analysis can be used to predict the probability that a 
particular job search and applicant referral will ifesult in a place- 
ment. In order to see how, assume that the profile of an applicant 
and of a job are as follows: 

1) -Applicant wants benchwork occupation. f'^ 

2) Computer is used for applicant search. 

3) Job requires only reading and writing. 

4) Job requires no experience. 

5) Applicant has a SpanisTi surname. 

6) Referral is made in August. 

7) Job is for 140 days. 

The probability of such a referral resulting in a placement can 
be computed as follows: 
.31 constant 
+.04 bfenchwork 
• +.11 computer applicant search 

0 no formal education requirement 
0 job requires no experience 
.06 applicant has Spanish surname 

2Seasonal^ factors alone suggest October is a high employment month. But 
high unemployment, in the area lowered the probability in October. * 
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.04 referral made in August 

— Q: job for under 150 days . » 

.56 applicant has probability greater than .5 of referral 
resulting in placement ererrai 

It is possible that a similar isbdel could be used to determine ' 
the probability of success before.a referral is made. Ideally, data 
would be collected on a number of job and applicant attributes that 
would lead to a good match, but that was not the objective of this 
project. ' . 

' There are extreme cases where the dependent variable is near zero 
or even completely negative. The white college student or graduate 
using the self-service mode to find a permanent job requi;ing experlenc 
In a professional occupation has a computed predicted variable of less 
than zero, it arises because some of the variables which were assumed 
to be additive actually interacted in a more complicated- way. ' 

.A number of specifications of interactions were Attempted, but 
they greatly complicated the model; the changes in most coefficients 
were minor, and the interaction terms were rarely significant. . 

Only two specifications are vorth illustrating. One concerns 
the treatment of veterans. Veterans Ver^ placed primarily by manual 
applicant search or walk-in. When a separate regression was run for 
applicants placed by these two methods, being a veteran improved the ' 
probability of placement by .24. However, this result is attributable 
in large part to the favorable treatment one large company gave veterans 
during the san>ple period. -The specification is illustrated as follows: 
H = .707 - UeSPERM - .587PRO + .242VET 
(7.8) (-1.9) (-4.8) (3.1) 

t statistics are shown in parentheses. 
r2 '= .218 SE = .43 n = 156 
Where 

H = 1 if a Jiire; 0 otherwise (placement probability) 
PERM = 1 if the job is permanent; 0 otherwise 
JRO = 1 if the job is a professional occupation; 0 otherwise 
VET 1 if the applicant is a veteran; 0 otherwise 
A variable for veteran status was not significant , in the other strata.' 

* V 
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The other specification of interest was a separate regression for 
'jobs requiring experience versus jobs not requiring experience. Table 
11 presents the results, i 

4 ' 

Pay By Mfethod . • ' 

Another factor important in evaluating the success of different 
placement methods is the starting pay offered. Table 12-^hows the 
pay by method, %\ 

A few dozen jobs that were excluded from the hourly pay averages 
pay on a commission basis. It was impossible to allocate an hourly 
rate to thesis jobs. 

Outside of manual applicant searches, which were done only in 
special ^circumstancets primarily for veterans, on-line job searches 
resulted in the highest average pay. Applicants could use the computer 
to find high-paying jobs-. The two next ^^high^est average wages were 
employment officer-aided search and applicant computer search. Self- 
service applicant searches resulted in considerably lower wages, 

i 

Occupational Distribution 

Table 13 presents the referrals made and^ placement rate by occu- 
pational group cross-classified by experience. 

In the blue collar occupations, experience was a more significant 
factor in explaining differences among hire rates. Table 14 shows hire 
rates by occupation according to search method, A breakdown by experi- 
eucef'^'ls" also given for the blue collar occupations. 
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TABLE 11. kULTIPLE REGRESSION MODEL 



Predicting Probability a Particular 
Referral Will Result in a Placement 



Variable 
Constant 

Method of Referral 

On-line search of 
job file 

On-line search of 
applicant file 

Job development 

Walk^in 

ES officer used 
microfiche 

« 

Call In based on 
computer sjd^arch 

(Self-service = .00) 

Occupation 

^ Clerical 

Professional- 
managerial 

Benchwork- 
structural 

(All others = .00) 

Permanent job 

Education 

Job requires some 
college 

(Job requires no 
college = .00) 

j 

Applicant has 
. Spakish *surname 

Referral in August 
or September ! 



Jobs Requiring 
No Experience 

Coefficient t Statistic 

•29 8.2 



,18 

.19 
** 

.34 
.59 



.06 



-.21 



-.11 



.04 



r2 = .245 
SE = .349 
n = 1413 



- 3.2 

3. A 
** 

9.9 

12.3 

** 
** 
2.8 

-6.3 
-2.9 



1.9 



Jobs Requiring 
Experience 



Coeffi\:ient 
• 11 

** 

'.08 
, ** 

^ .49 
.07 
.40 

- -.06 



** 



** 



.08 



.04 



= .081 
SE = .318 
n = 2334 



t Statistic 
8; 9 

** 

2.5 
** 

6.3 
3.0 

9.9"- 

-4.1 

. -/ 

L 

** f 



2.1 
2.9 



1 

*'|Variable not even significant at .10 level. 



TABLE 12. MINIMUM AVfiRAGE HOURLY 
, . PA.Y BY METHOD OF PLACEMENT 



Connnisslon Non-Comniission Jobs 

vjobs Hourly Rate Number 

1. On-line search of 

applicant file 2 -2.73 27 

2. On-line search of 

job file 1 .2.95 16 

3/ Self-service microfiche 15 2.43 228 

4. Self-service printout 3 " 2.46 54 

5. Employment officer - ^ | ' 

microfiche jo ,2.78 103 

6. Job development , I 1 * 2.55 27 

7. Applicant walk-in ^ jo ^ 2.31 14 

8. Manual applicant search _5 3,06 80 
All methods /27 2.67 ' 549 





TABLE 13. TLACEMENT RATE BY OCCUPATIONAL GROUP OF JOBS 
Bou;.der July 1, 1974 - October 30, 1974. 



" No Experience Required 
pccupation al Group Referrals^ . Placement Rate 



Experience Required 
Referral^ ^Placement Rate 



Professional 84 

Managerial 46 

Clerical, Sales , 213 

Service > 424 

Fanning ' 34 

Processing 43 

Machine Trade 41 

Bench Work 290 

Structural Work 93 

» 

Misc. ' , 140 



."05 
.04 

ao 

.19 
.14 
.10 
.09 
.34 
.31 
.19 



190 

147 
715 
465 
44 
17 
113 
116 
318 
212 



.05 ^ 

.01 

.10 

.14 

.13 

.17 • 

.18 

.12 

:i8 

.15 
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CHAPTER FOUR 
FOLLOW-l/P DATA 



Pollow-up data are an important component of a manpower 
information system. Unfortunately, the Employment Service standard 
data systems limit follow-ups to questions' about whether or not 
ah applicant referred by the Employment Service is placed. 

In the Standard Referral System, jobs are classified as 
1-3 days, 4-150 days, or, over 150 days. This classification is 
based on information receive^ from the employer at the time the job 
order is listed rather than on how long the applicant works. 

In this study, two evaluations determined the length of time 
employees spent on the job. The first evaluation used a telephone 
follow-up conducted approximately 100 days after placement by the 
Employment Service' local office. 

^ The second follow-up matched Employment Service records with 
tax records supplied by employers ,under a compulsory wage-records . . 
program. Under Colorado law, employers must report each employee's 
wages and^ocial Security number \very quarter.' The Social Security 
number of each applicant placed by the Employment Service was 
matched and his earnings determined. Data ort, each applicant's 
starting wages, taken" from Employment Service records, allowed 
evaluators to mdke a reasonable 'estimate of the length of time he 
had been on the job. • • ' 

If an employee had received a wage increase, it would bias upward 
the estimate of the time he had spent on the job. The combined use " 
of phone follow-ups and wage-record estimates on the same applicants 
provided a cross-check on the validity of .both sources of data. 
Employers do not always remember when employees terminate. Employers 
go out of business or sell their businesses. These factors fould 
make phone follow-ups even less accurate than wage-record estimates. 
The major error in wage records arose for applicants placed in October. 
There was less than three months of data on these applicants. 
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Although this error affects the slee of the estimate. It ^does not ^ 
affect the comparisons between placement methods. For the follow-up 
purposes., these errors were well vithln a tolerible range wjth either 
method. Combining methods improved the accuracy even inore. 

For met evaluation purposes, wages earned were of more interest 
than tlme .on the Job. If two . identical applicants Wer^ placed on two 
jobs and worked .the same length of time, but one applicant earned 
more than the other, the higher earnings would be considered to be 
^^more iitfpbrtant. 

Telephone Follow-up 

The telephone follow-up was conducted about 100 days after appli- 
cants were placed.l Employers were asked- the foHowing questions: ' 

1) What was applicant's date of placement (to cross-check 
against ES records)? . ' 

2) Is applicant still -working for you? 
^3) If applicant is still eii5)ioyed, 

A) what is his hourly rate? 

B) ■ hoy manx hours has he worked per week, on thp 

average.-- over the last three months? " 
4) If the applicant is no -longer employed, 

A) what wa^ his final hourly rate? 

B) when was his last date of employment? 

C) what was the reason for his departure? 

a) quit voluntarily 

b) fired 

c) layoff " • 

d) other > " * 



October and were carried our througrApm "iJl M?™ " 
^cSfe^Sler Z'l " '''V' "™ iL"-coSd"°r 
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We had some follow-up information on over 95% of all applicants. 
Successful tel^hone follow-ups were made on about 60% of the 576 
applicants. The local office did not make any ' follow-ups involving 
long-distance calls. Denver, about 4ff miles away, was a local call. 
One city, Longmont, .only, 12 miles away, was a Idng-distance call. 
Since many of the same employers were in the wage-records follow-up, 
there was little point in making tepeated calls to difficult-to- 
contact employers. What is more, the Coloirado Division of Employment 
^^frowned upon contacting employers for non-placement purposes. \ . 

Since the experimental objective was to determine the difference 
between computer and non-computer placements, and since the data * ' - 

collected was more than enougji for this purpose, t;he evaluators^ did 
not argue forcefully for additional follow-up instruments such as 
written questionnaires or employer interviews. It is difficult to ' 
resist the te^iptation of using the Boulder experiment to collect all 
^ kinds of information about the general ef fectiveness'^of ^the labor 

market, the placement process, and the Employment Service; but these ' 
issues were not paramount to the experiment. 

Continuous Wage History 

The Continuous Wage History File was matched against the Social 
^ Security numbers of applicants placed in the period^ Jyly 1,T.974 - 
October 31, 19741 Wage *i:ecords were obtained for the seven quarters 
• from second quarter 1973 to fourth quarter 1974. About 60 percent of ^ 
the applicants^ matched exactly on Social Security number and employer 
number. 

'The limited degree of success of the initial match was partly due^ 
to the coding of employer .identification numbers for the 576 placement's 
and partly to thejcoverage in effedt in 1974. If a similar project ^ 
was undertaken in 1975 using a computerized address ^fiie, 80-85 percent 
of all placements in Colorado could probably be matched, due to the 
'increased coverage of more employers and the increased ability of the 
computer to match , records. This improvement would be caused by the 
extended coverage of Unemployment Insurance ^and-^ the improved technology 
. ^ of using the computer to assign codes to employers. 

• ■ • •• ^7 • 



Information „is available even in cases where the .employer who 
hiyed the applicant was not the employer listed in the Wage-record 
file. In^these instances, the evaluators had the wage records of the 
"other" employer. " 

Finally, there was information on referrals made by the Employment 
Service for some non-matches. If an applicant was placed in a second 
full-time job a month after placement in a first full-time job, he was*' 
assumed to have worked less than a month in the" first job. 

There was some information on which to base an estimated separa- 
tion date for 550 of the 576 referrals resulting in placements. However 
separation dates were assigned to only 485 of them. 

Duration o f Job - ' 

— - " 

Table 15 presents the average number of days on the job based on 
our best estimation of separation days from all sources. The table 
shows average days on the, job by placement 'metH-od. . The table under- v 
estimates the actual . number of days 'worked because each applicant who 
was still employed at the time of^ follow-up was assigned the number of 
days between the date of hire and the date of follow-up. Follow-ups 
were conducted an average of 100 days after the date of placement, with 
a. range of 75 to 200. days. These are calendar d^ys from placem^t fe^ 
follow-up, not days worked. • , 

Table 15' shows tliat onrline applicant searches resulted in the 
highest average duration on the job of 7^ days, which was higher than 
by any other placement methods. Itenual applicant searches were next 
with 78' days. Many of these manual searches were for 90-day contract 
jobs, however. 

- • . «• 

Compute:^ on-line searches should show the greatest pay-off»on jobs * 
requiring experience because the search criteria are more complex. 
These jobs had an average 95Tday tenure. (Not shown in table.) 

The lowest tenure occurred on jobs found when the employment 
■officer help^'ed an applicant use the microfiche. Interestingly, these 
applicants h^d a considerably higher placement, irate than average, so 
that an' explanation- is not readily ''apparent. , ' 
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TABLE 15. AVERAGE NUMBER OF DAYS 
WORKED BY SEARCSl" METHOD AT FOLLOW-UP 
(Numbers in parentheses indicate observations) 



Search Method 


All 


Jobs 




On-line search of 
applicant, file ^ 


79 


(25) 




On-line search of 
job file 


72 


(16) 




Self-service 
microfiche 


60 


(192) 




Self-service 
printout' 


52 


(47) 




Employment officer^ 
, microfiche 


« 48 

* 


(91) • 




•Job development- vL- 


61, 


(24) 




■Applicant walk-in 


58 


(12) 




Manual applicant 
search 


• "78. 


(7/^) 
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Tafble 16 corrects, for the biases caused by applicants not having 
terminated by the time of follow-up "by showing the distribution of time 
worked by method. Tablfe 16 ^hows much the saine patterh asVable 15 
except that manual aj)plicant searches have more placements lasting 90 

• days or more. . • 

, Table 17 presents 4^a|e aggregate wages by placement method of 
employees in the third and fourth quarter of 1974. The longer appli- 

* cants were followed,' the more accurate the wage-record estimates could 
be. However, this increased accuracy is very unlikely to make any ' 
difference in the conq)arisons among methods. 

Table 17 again .'deiaonstrates consistently higher wages foir computer 
searches over self-servic? searches. Manual applicant searches, for 
reasons -previously Mentioned, also are consistently higher^than self- 
service. (I . " ^ 

• . ' ' • 

Limitations 

One possible' objection to the study is that applicants placed"^ by 
one method have sufficiently different characteristics from applicants 
placed by another me^od to invalidate the presumed effect of the 

search ifiethod. ■ / ' . 

. . ■• •$ ,1* / • 

In the ideal experiment, applicants would be selected at random 
or, better, by a selection procedure devised to insure that 'comparable 
control groups"- utlflze each method. 

These selectioir-proeeduresT-COtrld not be put into practice for 
several reasons.. First, it would l/ave been illegal; The ES was 
.required to give veterans preference over other applicants. Second, 
it could have created difficulty if aiolicants wanted to use .one < / 
procedure and were forc.ed to use another. Third, it wpuld have created 
an artificial situation in the bffice v.tilch taight have affected the 
results of the experiment. , • 

. A" alternative approach eiiq)loyed here was to stucly applicant 

differences among the dif ferentltefchods and report the net effect of 
each method. Multiple regression analysis similar * to 'that employed 
in Chapter 3 was used to control for other effects. ' 
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TABLE 17. AVERAGE AGGREGATE WAGES 
BY PLACEMENT METHOD 
(Number of placements in parenthesis) 



Search Method 


Total 


applicant file 


$1,116 (12) 


On-line search of 
job file 


$1,2*83 (11) 


Self-service 
microfiche 


$ 797 (146) 


Self-service 
printout 


$ 783 (36) 


Employment officer 
microfiche 


$ 914 (72) 


Job development 


$ 917 (20) 


Applicant* walk- in * 


$ 745 (10) 


-Manual applicant 
search 

• * 


$.1,514 (60) 

• 


• * 
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- In this 'context, multiple regression analysis holds the effect of 
"other variables constant and measures the net effect of the placement 
method. 

^Continuous wage history provided only 12 observations on appli- 
cant' searches. . It would be difficult to statistically disentangle 
the effects of other variables with these few observations. 

Occupational Differences 

Since applicants in certain occupations are more likely to be 
picked as a result of applicant search, and' these occupations have 
longer average tenure, we cannot tell from the regression whether 
applicants have t^he" longer tenure because of their occupation or the 
computer search. 

' Occupations wi'th the longer tenure include professional, clerical 
sales, farming or gardening, . and benchwork. The extra time on the job • 
ranged' from 17 days in benchWk to 43 day^ in farm and gardening. 
Clerical sales was 30. Professional was 35. • ~ 

Table 18 presents occupation by seafch method by average tenure 
on the job.- It appears that in occupations fox which five or more 
computer applicant searches were madfe; they resulted in higher tenures 
than^did every other occupation but manual applicanr searches. This 
finding suggests again that computer applic^t searches have a positive.^ 
effect on tenure even after occupational differences are taken into " 
account. The sample was too. small* to test this effect statistically. 

Separation Reason 

-The telephone follow-up determined, the ^reasons- for separation. 
It obtained data on about 200 referrals which led to jobs the applicant 
held less than 90 days. Of these, \he employer laid off 10- percent 
and fired 10 percent, while another 70 percent quit. Other reasons 
were given for the termination of the remaining 10 percent'. Applicants 
who quit were receiving $2.41 an hour, compared to $3.08 for those who 
were fired. 
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Table 19 presents separation reason, by method used to find the job 
for. applicants who worked less than 90 days. 

, Not a single applicant placed by computer was fired': Of the 25 
applicants placed by manual search, seven (28 percent) were fired. 
The universe is very ismall,- however. ' " ' 
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TABLE 19 » SEPARATION REASON BY SEARCH METHOD 
FOR APPLICANTS NOT WORKING AT FOLLOW-UP 

^ 



Search Method 


Fired 


Layoff 


Oth^r 


Quit 

f 


Total 
giving 
reason 


. Unknown 


Job development 


♦ 

, 1 


0 


3 


3 


! ^ 


, 9 


Applicant walk-in « 


0 


. o' 


0 


& 

5 


5 




Self-service 




5 


3 . 


^ 70 


87 


• 

36 


^ Self-service 
, printout 


.0 


2 


3 


15 




, 14 


Manual applicant 
search - 


*> 1 

. 7 


2 . 


2 


14 


•25 ■ 


* 


Empld3nnent officer 
microfiche 


. 3 


12 


6 


' 26 


47. 


* 

19 - 


, On-line search of 
applicant file 


»0 


1 


1 ■ 


6,' 


8 , 


•> 

4 


Op-line search of 
job file ^ 


0 ' 


0 ' 


0 


2 


2 


5 


t ' 


2(1' 


22 


18 


141 


201 ^ 


95 
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' ' • CHAPTER FIVE ^ 

COSTS, BENEFITS, AND DESIGN OF' AN OPTIMAL SYSTEM 



Intr oduction ' " , 

This.-< chapter describes the design of an optimal system for 
matcijiing and is based on the experience in Colorado. - 

\The Colorado Division of Employment is undergoing a major 
reorganization following the plan established^ ^y the Joint Evaluation 
0 Team»\ ifie plrimary objective of this, reorganization is ta enable the 
agency! to better serve its dl:J.ents, both applicants and employers* 
The Teoarganization serves as a model for other agencies. The agency 
wishes Eo'provlde self-service so that applicants can find their 
own iobs\in*Job Information Service (JIS) centers and to create 
case loacjs in srpecial Individual Development Service (IDS) centers 
to give more attention to target group needs. 

The Colorado agency is facing major legal actions that demand 
that it be responsive to certain target groups. As economic conditions 
changfe, there Is a constant need to reevaluate ways of meeting prior- 
ities^. One-time annual plamrtng^ must give , way to daily or weekly 
planning • Changing priorities can cause aflministrative nightmares 
in a manual information system. 

The Colorado agency is convinced that it needs a responsiVe 
information system to fcarry out ite mandate of change. This system 
would facilitate job matching and provide better utilization of the 
management information designed into the MODS system. It would 
be flexible enough to respond to changing. needs; every applicant 
would be exposed to every job opening on a continuing basis • 

The optimal system will be designed to provide hard .evidence on 
the relative usefulness of a variety of matching languages whic*h will 
be built into the experimental design of the project. Because of 
economies of scale in computer operation,* the system is most^ economical 
on a regional basis. 

'"''A report: by the Joint Evaluation Team spells out recommendations on the 
^ reorganisation. 
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The system will give special attention to employers. Job aimlysis 
data will be collected duritjg employer development visits and Mi 
available to job order takers. The 'interactive' system will brinf 
back the personalization lost when job order taking became cent-ralized. 

CUents, employers, and managers must be.provided with adequate 
information if the ES program is to succeed. 

Objectives of a Job Match Sy stem 

The ideal system would have the following objectives: 
■ 1) Redesign agency forms to maximize their usefulness in a 
computerized matching environment. 

2) Design, a 'placement information system to compare every 
worker to every jnh on a continuing basis. 

3) Tie, the system to a Regional Manpower Information Center. 

4) Study s-everal alternative matching algqrithms tor different 
classes of applicants or study an algorithm which bodies 
applicants haying differing characteristics in different 
ways. Different algorithms will be used and data will be 
collected on their effectiveness. 

. 5) Weigh the relative gain in placement quality and quantity 
(if any) against the relative additional cost (if any) of- 
a flexible language. 
6) Restore the individualized attention given employers through 
on-line storage of employer informatl'on. 
^, 7) Increase prpductivity of ES staff by designing a system to 
reduce the- paperwork which t'akes so much of .the 'employment 
officers' time. Manual files will be replaced by computer- . 
ized files whenever it is cost effective- to do so. 
8) Increase the usefulness of MODS data by permitting more ' 
flexible use of the data base. 
. 9)^ Design a system which facilitates continuous monitoring of' 
; • " service rendered special target ^ groups J i.e., minorities 
and veterans. 

Permit the computer to s4rve local officers instead of 
forcing local office staff to serve the computer. 
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Prof ectt Design * ^ % ^ v 

The proposed system will provide immediate' and comprehensive 
data about on-going- job placement operations/ It will eliminate 
hundreds of man and machine hours spent in preparing routine, and 
often unused^ reports. It will permit the following operations-: 

1) The on-gping analysis of ,ES penetration into the labor 
.markets. 

t 

2) Continuing validation of ES planning and in-progress planning 
changes. , - 

3) The creation of a single, regional data base. 

4) Computer modeling and forecasting of worker demand, industry > 
and labor supply. ' 

Alternative Job Match Languages 

Several Department of Labor job-applicant matching systems* have 
been developed. Wisconsin, Utah, and New York use on-line, real-time 
piatching. Other states are planning batch matching systems. 

It is proposed that applicants be matched using one of several 
algorithms selected on a stratified, random basis. Data on the 
algorithms' comparative effectiveness and on the effectiveness of ' • 
their various -characteristic's will- then be collected. Some algorithms 
will be tested for Certain occupational groups only. Others may be 
tested for all occupations. ' ' 

These system^ can be characterized four- ways: " ^ 

1) Degree of. Interaction with the user (batch or on-line3. 

2) Tjrpe of descriptor used* 

3) Algorithm used to m^tch. applicant and jobs. 

^4? "Degree of match, » 
Th^re are several descriptor types; 

1) fob Analysis Vocabulary v^AV) (use^^ en Lire system) . 

2) retailed Expetimental Qomputer- Assisted L^giiage (DECAL) 
» (entire system). ^ 

3) Dictionary of Occupational Titles (DOT). 
^ 4') Worker Trait Groups. 
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5) Free Form English* 

6) Selected skill indicators (which may be a part JAV or 
DECAL) such as MIPSWA, Education, Language, QATB^ GED, and 
SVP. 

There are various degrees of match* 

1) An EXACT match is required between descriptors and character 
is-tics specified and those matched (MUSTS only) , 

2) A BEST match is found by weighing some factors as more ^ 
important and other factors as less important (MAYS). 

3) ' A COMBINATION match uses both MUSTS and MAYS. 

Chart 1 shows the use of an exact match and a combination match in 
searching for applicants ."^ 

Matching algorithms can be characterized by the methods used to 
set weights for the match: 

1) Preset in the computer. 

2) Set based on applicant and employer choice. 
. 3) Selected by employment officers ♦ 

4) . Selected by terminal operator ♦ • * , 

Weights can be selected inte^ractively, as in the experiment; or 
they can be preset in batch matching ♦ 

It is impossible to specify exactly which of the hundreds of 
O ^ e tried , but 

continued experimentation will make it 

possible to narroV the range. 

Only applicants requesting the service will be included in the 
applicant file. Others can use self-service microfiche readers to 
select their own jobs. 

Training costs can be minimized by using teams trained in parti- 
cular search strategies and moving them from one office to another. 
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CHMIT 1, USE OF MATCHING IN APPLICANT SEARCH 

EXACT ; ' * 

5 . ■ 

«■ Find in APES where OCC is clerical and EXPERIENCE > 30 and 

MINPAY < 3.00 and TYPING > 60 and SHORTHAND > 80 and FORMER EXPERIENCE 

is ADMIN, and MIPSWA is 17194 and 17130. 

COMBINATION ; 

Find in Apps where OCC is clerical and EXPERIENCE maybe > 30 
and MINPAY < 3.00 and TYPING > 60 and SHORTHAND maybe < 80 and FORMER 
EXPERIENCE is ADMIN, and MIPSWA is 17194'and 17130. 

MIPSWA; 

47194 = im Selectric 
17130 = IBM Transcriber-- - 



NOTE: Abbreviations could be used in actual practice but are not 

shown in this example because they would make the example less 
clear. 
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Proposed Activity In the IDS Offices 

Fivje IDS office activities used to illustrate the use of the 
proposed placement-information system are described below. Each 
assumes that operations go through a centralized terminal operator 
in each ^gd^fice. 

Activity No. 1 Recording Job Orders 

Currently, valuable information is not available to job order 
takers. They cannot draw on ES employer histories, and each eiiq)loyer 
must repeat his personnel needs with each set 'of job orders. A job 
order^s circulation ^ delayed until the day after it is received. 
Manual files are seldom searched for suitable applicants. 

In the proposed , system, the job order taker will 'given three 
kinds of background information: 

1) Characteristic's of the firm. 

2) Existing job classification and placement history. 

3) " Record of ES services to this employer (see charts 2 and 3)* 
This information would be recorded for frequent ES users only. The 
quantitative decision setting. the breakpoint between frequent and 
other users can be -made as data are collected. 

After the job order 'taker has processed a job order and entered 
m it into the system, a standard applicant search will be performed, 

and a list of prospective applicants will be produced. (See Figure 2.) 

Activity No. 2 - Applicant Search ^ 

Applicant searches will be carried out at the following times: 

1) When the job order first enters the system. 

2) Two days after the job order enters the system if no 
referrals have been made at the time. 

' 3) At weekly intervals after entry into thd system. 

4) . On special request, e.g., as part of a special service to 
' employers. 

Applicants can call a phone number to determine if their application* 
was matched on a given day if they do not have a phone number. 
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CHART 2. HYPOTHETICAL COMPUTERIZED EMPLOYER RELATIONS FILE 



Employer Name. ^ - ABC Company 

Address _ 14444 WrlAth Street 

City, State, ZIP ^oulder, Colorado 80302 

Employer ID . 12345678901 

Nature of Business - Paper Wholesaler 

If of Job Orders last 12 rnqpths - 7 

if of Referrals last 12 months — 12 

# of Hires last 12 months - 3 

Person^;iel Contapt - Alice Jones 

Employers Job Classification it - Job 'Title 

101 - Prograimner 

109 :;^Sr, Systems JThalyst 
' 135 - Computer Operator 

212 - Keypunch Operator 

501 - Secretary 

812 - Foreman 



989 - Laborer - 



NOTE: For each job classif icatpl' there is a second set of information. 
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CHART 3. SAMPLE REQUESTS FOR EMPLOYER FILES 



1) GET FIRM WHOSE PHONE IS 452-4116 

or 

. GET FIRM WHOSE EMPLOYER ID IS 12345678901. 

The telephone number or the employer ID of the firm can be used 
as an index. 

2) DESCRIBE 30B CLASSIFICATION 989 > " 

A. detailed description of this job class is then printed. 

3) DISPLAY PLACEMENT FOR 989. 

The new hires through the ES for this job class are printed. 

4) CREATE NE« JOB CLASSIFICATION 

A new job classification is added to the employer's records. " 

* * • 

5) PLACE ORDER FOR 135- * 

A job order for a computer operator is to be added to the job 
bank immediately. , 



4' 



64 

• 73' 



Activit y No. 3 - Recording Applicant Characteristics 

" The applicant will fill out ouch of the applicant characteristics 
form himself, assisted by an audio/visual aid such as a carousel/ tape 
recorder combination. The interviewer will- add to the farm those 
answers which require his judgment and expertise. The completed form 
will be given to the terminal operator for entry. (See Figure 3.) 

Activity No. 4 - Joh Searrh 

■ The job search can be initiated whether the applicant is-p^esent 
.or not. The latter use might occur as an employment of fleer works on 
his caseload or gives special attention to a target group. Or, an 
applicant might telephone or mall a search request, in response to a 
mail campaign, perhaps. 

«- Figure 4 illustrates one type of job search. In this example, 
the interviewer specifies an applicant's job requirements and gives 
them to a terminal operator. The results of the search are returned 
to the interviewer. " 

Activity No. 5 - Request for Referral ' 

A request for permission to refer might be initiated by an 
interviewer as a result of JIS activity, as part of a fully computerized 
job-applicant match, or for some other reason. When permission 'to 
refer an applicant to a job is requested, the computer will calculate 
a closeness-of -match lndlcat"^r if any mqjre referrals can be made. This 
indicator .could be a number from 0 to 99. 

An example of the way this indicator might be used follows. 

1) If the Indicator is between 71 and 99, the applicant would 
be referred without further screening by an interviewer.. 

2) If the indicator is less than 70, a screening lntel^view with 
an employment officer would be required. 

3) If the indicator is less than 30, the system would indicate ■ 
that the probability of the applicant being placed is small. 

4) The interviewer would have the final decision in toth (2) 
and (3). . ' • 



5) Statistics on the success of this screening' aid could, be 
easily collected, 
si 6) The breakpoints in this example are illustrative. The alr- 
gorithm for determining t4ie closeness of match would be 
modified as experience accumulates. Initially the break- 
points would be low and would be adjusted upward with the 
accumulation of experience. 
(See Figure 5.) 

^ Activity No. 6 - Recording' Referral Results 

When results of a referral are known, they will be recorded on 
a standard form and given to the terminal operator (See Figure 6). 

Figure 7 illustrates the combined on-line operations in the 
IDS office. An example of priorities used to determine which activities 
the terminal operator will process first follows: 
' 1) Referral Request.^ i 

2) Job Search 

3) Applicant Characteristics Entry 

4) Referral Results 

Job order entry would be handled by a different order taker/operator. 

Transf er of Information Between State Agency and the Regional Computer 

To carry out the. experiment as outlined, the data processing 
facilities at the state agency and the regional center must work in 
unison. One proposed flow of information in a batch environment 
between the two computers is illustrated in Figure 8, Each step 
of the process is described below. 

1) Data Entry: Job Bank and other Employment Service forms will 

be entered on-line using a. key entry system with a mini computer. 
,^2) Transmission to the Regional Computer: Data collected above 

would be transmitted to the region in the evening and would be 
availabl^e for retrieval the next day. Several transmissions 
per day may be desirable as well, depending on the load. 
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3) Update System: . The data received at the region will be used 
as ingut to the Update System, which will update the job, 
applicant, and reflrral data sets and produce information for 
transfer to the Job Bank microfiche. ' j \^ ' 

4) Transmission Back to Minicomputer: The information needed 
to produce the Job Bank will then' be transmitted back to 

• the agency minicomputer^ 

5) Processing of Regional Data: The tape produced on the mini- 
computer can then be used on a tape-to-mlcrof iche production 
facility to produce the Job Bank microfiche. 

' / 

I 

Job Order Control 

All requests for referral in the IDS offices are to be made 
directly on computer terminals. The system will keep track 
of placements, and it will record basic information about the 
applicant, and interviewer when a referral is made. 

All other offices will telephone Job Order Contrpl to request 
permission to refer. While the interviewer^s on the phone; a Job ■ 
Order Control staff member will perform the referral request on a 
terminal at the control site. 

Thus, all': referral activity will take place on-Mne, either 
directly or indirectly. (See Figure 9.) , 
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gtapXoyer Developm ent 

Over the past several- yeats , employers have felt tha£ .their rela- 
tions with the Employment Service have become d^epersonalized.' A new'' . 
■ procedure to integrate employer-visit information with the order-taking 
process was previously described. It will require employment servi^ 
job developers to build up occupational descriptions profiles of em- 
ployers likely to. list with the ES. 
^ To facilitate the strategy for employer visits, employment fore- 
casts will be made by occupation, industry, and firm. On the basis 
of -these forecasts, employers will be selected for more or legs inten- 
sive employer development. Data on job orders will be matched with 
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other employer data such as 1:otal hires by existing wage-record data. 
Goals will be set for job drder development, and the success of various 
job developers will be monitored. ^ 

Timing Considerations • — » 

There is much overlap in the periods of execution of the eight 

phases in this system, A minimum of one year is required to start the 

project. The fallowing phases are envisiohed: 
1) Forms design - 2 months. ^ 

2^ Systems ^development to point t>f testing at first office - 
8 months. 

3) Systems e^qpansion to additional offices and initial training - 
4 months. ^ • 

Although the steps will overlap somewhat, delays in one phase can 
delay subsequent phases. Delays may ot may not aff ept the total cost of 
the project. 

Evaluation 

Evaluation of alternative matching strategies is an important 
aspect of the proposed system. This evaluation will require the 
collection of detailed management information on applicants and jobs; 
and as a by-product of this project, very detailed management infor- ^ 
matioiii on the performance of the Employment Service will be provided 
to local office managers, area managers, and state, regional, and 
national offices . 

The following search strategies illustrate the types of st'»-ategies 
to be tested and compared. 

1) Employment Service officers will use a flexible retrieval 

language to match applicants and jobs. They will query the ^ 
applicant file; and the number of applicants selected Vill 
be sequentially reduced until, in the judgment of the em- 
ployment bfficer or terminal oeprator, an optimal match 
occurs. , " • " 

2. Character descriptors such as .the DECAL vocabulary will be 
used. • * , 

. 76 



3) Different factots such as pay and location will be weighted; 
and matcli will be based on these weighted factors, which 
will be preset for all applicants. 

4) Weights will be recorded for each applicant at the time of 
app li ca t ion^ - — 

Pjroups of en^loyment officers wij.1 be trained iri alternative 
strategies and will be moved from office to office to make it possible 
to use different strategies over tirae in each office. Since detailed 
data will be collected on each applica.nt, it ^should be possible to 
separate out applicant characteristics, search strategies, and seasonal 
and econpinic factors affecting placement • 

Some differences in strategies do not rciquire that the employment 
officer learn a different procedure. For example, the computer can 
select one of the three matching algorithms on a stratified random 
basis and record the one selected. In one instance, the computer might 
search six-digit DOT; and finding no match, it might then match on 
Worker Trait Group. In another instance, it might match on three- 
digit DOT. 

As enough information is collected to evaluate > procedure, 
refinements and eliminations can be made continuously in an effort 
to achieve the best matching algorithm(s) . i. 

Factors affecting placement success include duration of job, wage 
paid by job, and average hours of job per week. The number of. success- 
ful placements and the, number of applicants sent to jobs and determined 
by employers to be unqualified are other criteria. 

In a wage-record state, a continuous wage history file is main- 
tained to provide data on the earnings of every person employed in the 
state by every employer covered by the law. Thus, it is possible to 
match the applicants served by the Employment Service against their 
wage records before and after placement to determine the earnings of 
persons placed in most jobs./ • ^ 

It is also possibJLe to match j-ob orders against to tar new hires 
to determine the penetration bf job orders into various occupations 
and Industrie^ 
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Costs and Benefits of Proposed System 

The cost of the proposed system would depend on the size of state 
or states Sserved in the system, the equipment used in the state, the 
software and operating system used, the amount of research actually' 
carried out relative to operations, the number of years for which the 
development is undertaken, the use made of software already developed 
by the Department of Labor, the other uses of thfe machine, and constant 
changes in the price of computer hardware and telecommunications costs. 
Such things as the availability of a microwave communications network, 
for example, can drastically lower the costs of telecommunication. 

However, assuming a new system were written for a regional center 
operating in the Denver region, meeting the approximate description of 
the system described in this chapter, designed over three year^ and 
serving the states except Utah in the region, the developpent cost 
would be about $300,000, evaluation would cost about $200,000, jgjgaining 
would cost about $200,000, and operations would cost about $500,000/ 
year / 

, Sinc^ the system could also accomplish many of the objectives of 
existing programs, the net cost would be smallet. 

Table 26 illustrates the current operations performed in a local 
office in a manual mode and the time that could be saved in' an auto- 
mated office. Table 21 gives more detail on the manual operations and 
shows a (Jeftcit in time required to perform them. 

The computer would not save much money by replacing existing staff, 
however, for two reaspns, 

"1) Many' of the functions suggested in Table 21 are not 

currently adequately performed in most local offices, 
2) The performance of these functions cpuld increase job * 
placements which would prevent the new technology 
from leading. to layoffs in staff. 
The system is sufficiently costly that unless it is eventually 
adopted on a regional basis as suggested in this proposal or unless 
the development costs can be amortized among,,a large enough number of 
centers, (say five), it is probably not cost justifiable as compared 
with" hiring more ES officers. Permitting each state to develop its 
own matching system would be very expensive, 
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TABLE 20. ILLUSTRATIVE EXAMPLE OF OPERATIONS 
IN MANUAL AND COMPUTERIZED MODES 



Accepting Repeat Job Order 

Accepting New Job Order 

Initial Interview With Applicant 

Search Applicant File For New Job Order 

Search Job File For Applicant ' 

Applicant's DOT Matches Job DOT. , 
Applicant's DOT Does Not Match 



Screen Applicants for Referral and 
Request Permission to Refer 

Fill Out Referral Card and Perform 
^Follow-up 

Daily Purge of Applicant File 

Work on Applicant Caseload and 
Job Developmerit ^ ' 

Referral "Short-Order" Job Actuary 

Other Paperwork 



Ideal^ 
Manual 
Operation 

10 min 

c 

10 min 
' 15 min 
30 min 



2 min 
25 min 



10 min 

,10 min '\ 
30 min 

60 min 
10 min 



Proposed 
Automated 
Operation 

2 min 
5-10 min 
IDS: 25 min 
JIS: 10 min 



30 seconds if 
criteria on 
applicant is 
prerecorded 
else 10 min 



1 min 

5 min 
1 min 

15 Inin 
10 min* 



4 hrs/day 1 hr/day 



Source: Estimates based on observations in Boulder, Colorado, 

and discussions with ES staff, not on formal time study. 
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TABLE 21,. COST MODEL: ILLUSTRATIVE EXAMPLE 
STAF.FING OF PLACEMENT OPERATIONS IN HYPOTHETICAL LOCAL 

MANUAL SYSTEM 

PTE 

1/2 Manager/Assistant Manager 
1 Counselor 
5 Employment Officer 



OFFICE 



ActivUty 

1 Job Orders Taken 

2 Applicant Interviews 

3 Search Applicant File 

For New Job Orders 

4 Short Orders Taken & Referred 

5 Screening & Referral of 

Job Applicants 

6 Employment Officer Aide3 

Job Search 

7 Case Load/Counseling 

3 Job Development (Visit) 

9 Phone 

10 Follow-up & Paperwork . 

11 Daily Purge of Applicant File 

12 Training 

13 Vacation/Sick Leave 

14 Other Work 



Time Per 
Frequency Transaction 



30 
50 

20 
10 

40 

20 
6 
2 
10' 
60 
1 



10 

15 

30 
9 

10 

25 

60 
60 

5 
10 
30 

120 

240 

240 



Time Required 
Per Day 

300 

750 

600 
90 

400 . 

500 
360 
120 
50 
600 „ 
30 
.120 
240 
240 



available minutes /day 
deficit 
or 



4400 min/day 
2925 min/dav 
1475 min/day 
50% 



Source: See Table 20. 
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CHAPTER SIX 
LIMITATIONS OF THE StUDY 

The site selected had some disadvantages: 

1) Computer searches are most likely to be beneficial when 
the metropolitan area In question is very large. Boulder 
is not as large as Denver and is somewhat removed from 
the Metropolitan Denver job market by its distance from 
the city. ^ 

2) The city of Denver has a morfe typical labor market than 
Boulder does. Moreover, since the University of Colorado 
is located tn Boulder, Boulder has many*of the special 
labor market characteristics of a college town. 

3) The Boulder local office makes many short-tepj placements 
for jobs of short duration (1-3 days). 

4) Even before the experiment began, the eii5)loyment officers 

* 

complained that they had little time to perform job 

V 

searches for applicants. Therefore, they might not use 
an on-line system in the job search process because they 
spent very little time performing this activity. 

5) An applicant self-service system was installed in the 
Boulder office just before training for computer-aided 
placement- began. As a result, the effect of the computer ' 
system could not be adequately evaluated through comparl- 
sons of placements in the Boulder office with placements 
in other offices. 

6) The manager and assistant manager were transferred during 
the training ^T)erlod. The terminal operator left during 
the training period. ^ * 

The design and operation of an optimal matching system for Colorado 
would cost several i^illion do4.1ars over a 3- to 4-year period. Such a 
system w^s described in "Chapter 5,. The system used in the experiment 
took existing reporting forms and modified them fi^r use in a matching 
system, ' * ' 
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During about one-fourth of j;he elcperlmental period, the on-line 
system could not be fully used, because: ^ 

1) The Employment Service computer in Dehver did not transmit 
data to Michigan. * y 

2) The University of Michigan con5)uter w^&^t operating. 

3) .The computer terminal was'^not operating. 

Vmen any one of the sd- problems arose, the experiment could' rtqt 
be fully carried out that day. None of these failures dre related to 
the remote location of the computer. In an actual large-scale, multi- 
site implementation, several terminals might be used in each local 
office, a back-up computer might be available, and a higher priority 
•might be given to the transmission of data than could be given by the 
Colorado Division of Employment. 

Assuring a higher degree of reliability in a one-office experiment 
would have doubled the cost of this experiment. On the other hand, in 
a full-scale operation the same increased reliability might have re- 
sulted in only a fractional increase in costs, ^ * . 

When analyzing comparisons of placements made with or without thp 
on-line system, it should be' remembered that terminal placement could 
be made during only about three-quarters, of the number of days the 
experiment ran. " 
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APPENDIX A 



Abridged Version of Users Guide 



' Used in Trainin^of ' 

Employment Officerjs and Terminal Operator'^ 




i 



The original guide was written by Michael A, Kahn and Paula H. Harbison 
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DOCUMENTATION A-lI JOB ORDER FILE DESCRIPTION 
THE JPB BANK DATA SET 



JOB DATA SET 
USE COUNT t 



F(#) FIELD NAMh 



ABBR 



c VALUE DESCRIPTION 



F( n JOBORDERNUM 

F(2) D0TIT06 

F(3) DOTITOI 

F(4J D()TIT02 

F(5) DOTITOJ 

F(6) D0T4T06 

F(7) DATA 

F(8) PEOPLE 

F(9) THINJS 



F(IO) DURATION 

CATEGORIES 
NOREPLY 
PERMANENT 
DAYSIT03 
DAYS4T0I5O 
SEASONAL 

Fdl) HOURS 

CATEGORIES 
NOREPLY 

F( 12) ) WORKWEEK 

CATEGORIES 
FULL 
PARTIAL 

NOREPLY 

F(U) EDUCATION 

CATEOWRIES 
UNSPECIFIED 
FIRST 
SECOND 
THIRD ^ 



JOB# 
DOT 

DOT I 
D0T2 

D0T3 

DPT 

DATA 

PEOP 

THNC 

DURX 



HRS , 



rtKWjC 



EDUC 



JOB ORDER NUMBER 

•OCCUPATION CODE - 
DIGITS » 

OCCUPATION CODE - 

OCCUPATION CODE - 
DIGITS 

DCCUPATKJN CODE - 
3RD 



DOT 1ST THRU 6TH 

o 

FIRST DIGIT ONLY 
DOT I ST AND 2ND 

DOT 1ST THROUGH 



OCCUPATION goDE - DOT 4TH THROUGTH 
. 6TH DIGITS ( DATA-PEOPLE -TH I NGS ) • 



OCCUPATION CODE 
(DATA) 



DOT 4TH DIGIT 



OCCUPATION CODE - D()^5TH DIGIT 
i PEOPLE) ^ 



DOT 6TH DIGIT 



DCCUPATION CODE 
(THINGS) 

DO RAT I ON OF JOB 

0 NO REPLY 

1 MORE THAN 150 DAYS 

2 I TO 3 DAYS 

3 4 TO IbO DAYS 

4 SEASONAL 



NUMBER OF HOURS OF WORK PER WEEK; 
ZEm MEANS NOT AVAILABLE 

0 NO REPLY 

IS JOB PART--TIME OR FULL-TIM^? 

1 HOURS TO BE WORKED ARE 35 OR MORE 

2 HOAJRS TO BE WORKED ARE LESS THAN 

35 

0 NO REPLY 

EDUCATION LEVE^ COMPLETED 

0 *NOT APPLICABLE OR NO REPLY 

1 COMPLETED FIRST GRADE 

2 COMPLETED SECOND GRADE 

3 COMPLETED THIRD GRADE 
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DOCUMENTATION A-t* 



Continued 



JOB DATA SET 



(CONTINUED) 



F(#) FIELD NAME 



AB5R 



CATEGORIES (CONTINUED) 
FOURTH 
FIFTH 
SIXTH 
SEVENTH 
EIGHTH 
NINTH 
TENTH 
ELEVENTH 
HIGHSCHOOL 
COl-LEGEI 
C0LLEGE2 
COLLEGES 
BACHELOR 
MASTERS 
MASTERS* 
PHD 



F< 14) 
F( 15) 

Ft 16) 
F(l 7) 



EXPERIENCE 

TRAINEE 

CATEGORIES 
YES 
NO 

ZIPCdDE 

CATEGORIES 
NOREPLY 

COUNTY 

CATEGORIES 
NOREPLY 
XDAMS 
ALAMOSA 
ARAPAHOE 
ARCHULHTA 
BACA 
BENT 

BOULDER ^ 

CHAFEE 

CHEYENNE 
. CLEAR CREEK 

CONEJOS 

COSTILLA 

CROWLEY. 

CUSTER 

DELTA 

DENVER 

DOLORES 

DOUGLAS 
• EAGLE 

ELBERT 



EXP 
TRNE 

ZIP 



VA L UE DES CR I PT I ON 

4 COMPLETED FOURTH GRADE 

5 ^COMPLETED FIFTH GRADE 

6 COMPLETED SIXTH GRADE 

7 COMPLETED SEVENTH GRADE 

8 COMPLETED EIGHTH GRADE 

9 COMPLETED NINTH GRADE 
»0 COMPLETED TENTH GRADE 

11 COMPLETED ELEVENTH GRADE 

12 HIGH SCH(X)L GRADUATE 

13 COMPLETED I YEAR OF COLLEGE 

14 COMPLETED 2 YEARS OF COLLEGE 

15 COMPLETED 3 YEARS OF COLLEGE 

16 RECEIVED BACHELOR^S DEGREE 

17 , RECEIVED MASTERS DEGREE 

18 DOING ADVANCED rtORK 

19 - RECEIVED PHD 

EXPERIENCE REQUIRED IN MONTHS' 
TRAINEE ACCEPTED? 

1 YES 

2 NO 

ZIP CODE OF EMPLOYER 

. q" NO REPLY 

COUNTY CODE OF EMPLOYER 

0 NO REPLY 

1 ADAMS, a) . 

3 ALLAMOSA CO. 
5 ARAPAHOE GO. 
7 ARCHULETA* CO. 
9 BACA CO. 

M BENT CO. 

13 , BOULDER CO. 

15 CHAFEE CO. 

17 CHEYENNE CO. 

19 CLEAR CREEK CO. 

21 CONEJOS CO. 

23 COSTILLA CO. _ 

25 ^CROWLEY CO. 

2 7 CUSTER CO. 

29 DELTA a). 

31 DENVER CO. 

33 DOLORES 

J 5 DOUGLAS CO. 

37 EAGLE CO. 

39 ELBERT CO. 
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JOB DATA SET 



DOCUMENTATION A-1. Continued 



(a)NTlNUED) 



F<#) FIELD NAME 



CATEGORIES 
EL PASO 
FREMONT 
GARFIELD 
GILPIN 
GRAND 
GUNNISON 
HINSDALE 
HUERFANO 
JACKSON 
JEFFERSON 
XI on A 
KIT CARSON 
UKE 

LA PUTA 

LARIMER 

LAS ANIMAS 

LINCOLN 

LOGAN 

MESA 

MINERAL 

MOFFAT 

MONTEZUMA 

MONTROSE 

MORGAN 

OTERO 

OURAY 

PARK 

PHILLIPS 
PITKIN 
PROBERS 
PUEBLO 

rio blanco 
rio grande 
roJtt 
saguache 

SAN JUAN 

SAN MIGUaL 

SEDGrtiCK 

SUMMIT 

TELLER 

WASHINGTON 

YiELD 

YUMA 



ABBR 



Value description 



(CONTINUED) 



F(ia) PAY/YEAR 

F( 19)' PAY/MONTH 

F(20) PAY/WEEK 

F(2i) Pay/hour 



YRS 
M()$ 
HK$ 
HR$ 



41 EL -PASO CO. 
43 FREMONT CO. 
45 GARFIELD CO. 
47 GILPIN CO-. 

-49 GRAND Q). / 

51 GUNNISON CO. 

b3 HINSDALE CO. 

55 HUERFANO CO. 

5 7 JACKSON a). 

59 JEFFERSON CO.' ^ 

61 KIOWA CO. 

63 KIT CARSON CO. 

65 LAKE CO. 

6 7 LA PLATA CO. 
69 LARIMER CO. 

71 LAS ANIMAS CO. 

73 LINCOLN CO. • 

75 LOGAN CO. 

77 MESA CO. 

79 MINERAL CO. 

81 MOFaAT CO. 

83 MONTEZUMA CO. 

85 MONTROSE CO. 

6 7 MORGAN CO. 

89 OTERO a). 

91 • OURAY a). 

93 PARK CO. 

95 PHILLIPS CO. 

97 PITKIN CO. 

99 PROWERS CO. 

101 PUEBLO 

103 RIO BLANCO CO. 

105 RIOGRANDE CO. 

107 ROUTT CO. 

109 SAGUACHE CO. 

110 SAN JUAN CO. 
113 SAN MIGUAL CO. 
115 SEDGWICK CO. 
117 SUMMIT CO. 

1)9 TELLER CO. 

121 hASHINGTON CO. 

123 hELD a). 

125 YUMA CO. 

ESTIMATE OF YEARLY MINIMUM PAY 

ESTIMATE OF MONTHLY MINIMUM PAY 

ESTIMATE OF WEEKLY MINIMUM PAY 

ESTIMATE OF HOURLY MINIMUM PAY IN 
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JOB DATA S6T 



DOCUMENTATION A-1, Continued 

(corrriNUED) 



F(#X FIELD NAME ^ ABBR VAJ-UE DESCRIPTION 
\ 



DOLLARS AND-tENTS (WITH DECIMAL 
POINT) 

F(22) ORDERDATE DATE DATE JOB ORDER'WAS PLACED (YRMODA) 

CATEGORIES ^ . 

NOREPLY » 0 NO REPLY ' - ^ 

F(2J) PROCESSDATE ^ JUL^ ^ JULIAN DATE OF DHNVER PROCESSING 




' ' " EXAMPLE A-1. 



THE JOB BANK DATA SET'' 



Sam S, a young man, comes in seeking work as a truck 
driver. He young and has no experience driving a truck. 
Since the first DOT Sigit for jobs in the transportation area 
is nine, you might sjiart with that as a criterion for a FIND: 

*READYr , 

-find in jobs where dot! is 9. 

* 202 (8.58%) RECORDS FOUND 

* 202 RECORDS IN RESULT SET 

Since that produces too many jobs, the list can be narrowed 
by adding the second DOT for more detail: 



*READY: 

-find is result where dot2 is 90. 

* 50 (24.75%) RECORDS FOUND 

* 50 RECORDS IN RESULT SET 



Now the range of jobs can be further restricted Tjy searching 
for those requiring limited experience: 



*REAPY: 

-find in result where exp<9. 
**25 (50.00%) RECORDS FOUND 
* 25 RECORDS IN RESULT SET 



Note that the percentages refer to the 'previous set and not the 
original set. For example, 25 out of 50 or 50% of all jobs where 
dot2 is 90 require under 9 months' experience. 



90 
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EXAMPLE A-1. Continued 

Now you can find out how much experience^ each job requires 
and which will accept trainees; 

♦READY: 

-name result t. 

♦READY: ^ ^ 



-X in t exp and trne. 

♦ 05 RECORDS IN RESULT SET 

♦ 25 RECORDS REPRESENTED 



♦READY: 
-p it. 

♦EXPERIENCE TRAINEE COUNT ' • 

♦ 0 YES / 9 

♦ 0 NO -2 

♦ 3 YES - 2 
♦. , 6 YES 1 

♦ 6 NO n 

♦END OF DATA SET 
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EXAMPLE ^-1. Continued ' 

Now you can further narrow the job list down to those which 
will accept trainees and those which require no experience. 
Then you can find th^ starting pay range of these jobs and 
how many there are a^ the top pay level. 

♦READY: . 
-find in t where trainee is ves. 
*"12 (48.00%) RECORDS FOUND ' ' - 
* 12 RECORDS IN RESULT SET 



♦READY: 

-find in result-where exp=0. 

* 09 (75.00%) RECORDS FOUND 

* 09 RECORDS IN RESULT SET 



*READY: 

-p in result hr$. 
*PAY/HOUR ■ 
*2,0p.. 
2.25- 



1.75 
2.00 
2.25 
2.5b 
2.00 



* 
* 
* 
* 
* 
* 

* • .2.50 

* 2.36 

*END.'0F DATA SET 



♦READY: 

-find in result where hr=2. 50. 

* 02 (22.22%) RECORDS FOUND ' 

* 02 RECORDS 'IN RESULT SET 




92 



EXAMPLE A-1. Continued 



Now that you have narrowed the available jobs down to a workable 
number meeting as many -of the applicant's criteria as possible,' 
•you can print the job descriptions.^ 



♦READY: 

-display job desc. 



* 
* 



*. *** JOB NUMBER 572442 *** 

*905. 883 03/18/74 TRUCK DRIVER 60HR bUR=SEASONAL TRNE=OK 

* » 

REQ: ' ,' 

* • • - SIC=0714 

* PAY=00002. 50-00003.00 /HOUR NO TEST REQD L0= 
*EDUC=RW EXP=OOWOS BENEFITS= • ' SD= ' ^ 

* HOURS OF -WORK FROM 9-10: OOAM TO 8-9 :00PM DEPENDING ON WEAT 
HER. WORK TO START ABOUT THE MIDDLE OF MAY & RUN THROUGH D 
ECEMBER. START COMBINING WHEAT IN VERNON, TEX & WORK KS, 
COLO, & NEB. COMBINE BARLEY IN SAN LUIS VALLEY & END UP IN 

GARDEN CITY COMBINING MAIZE. APPLY SAP-WORK TO START ABOU 
T ABOUT MIDOL-E OF MAY. 

* *** JOB NUMBER 577569 *** ' • 

*906. 883 03/29/74 TRUjCK DRIVER LIGHT 44HR DUR=PERMANENT TRNE=OK 

* . REQ: 

*■ CALL FIRST • ^ SIC=5065 

* PAY=00100,00-00125.00»/WEEK NO TEST REQD- L0= 



*EDUC=12YRS EXP=OOMOS BENEFITS= ■ SD= 

* 8:00 5:30 MON-SAT 1/2 DAY EVERY OTHER SATURDAY TO WORK AS 

* A TRUCK DRIVER AND STORE CLERK. PICK UP AND DELIVER ELECTR 

* ONIC PARTS IN THE DENVER METRO AREA. .MUST HAVE SOME' KNOWLE 

* D6E OF ELECTRONIC AND MUST KNO'W THE DENVER METRO AREA ' 



■''Sotne fields have been suppressed to protect confiden- 
tiality of employers. * ' 



EXAMPLE A- 2. 



THE JOB BANK DATA SET 



Jetty R comes in looking for a job as a waiter. 
You might .give the following commands, beginning by using the 
first three digits of that occupation's DOT: 



* READY: ^ . 
"find in jobs wliere county is boulder. 



* 144 (6.12%) RECORDS FOUND 

* 144 RECORDS IN RESULT- SET" ^» 



*READY: • ' ' - 

-find in result where dot3 is 311, 

* 02 (1.36%) RECORDS FOUND 

* 02 RECORDS IN RESULT SET 



*READY: • - ' . - 

-disp job desc. 

* *** JOB NUMBER 565900 *** 

*31 1.878 03/11/74 WAITRESS/WAITER 38HR DUR=PERMANENT TRNE=OK 

* REQ: . \ 

* SIC=5812 

* PAY=000Q1. 00-0000 1,10 /HOUR NO TEST REQD L0=0400 

* EDUC=RW EXP=03M0S BENEFITS= SD= 

* 2 SHIFTS. AVAILABLE: 10:30 AM TO 5 PM AND 5 PM TO 8 PM.-6 

• D P W. OFF MONDAY. SALARY PLUS TIPS, PLUS MEALS'. MUST HAVE 
TRANSPORTATION. PREFERS EXP. BUT WILL TRAIN RIGHT PERSON. 

* *** JOB NUMBER 565907 *** . - 

*31 1.878 03/13/74 . BUS PERSON ' 30HR DUR=PERMANENT •TRNE=OK 

* REQ: . 

* SIC=5812 
*BOULDER PAY=00001.60- /HOUR NO TEST REQD L0=0400 
*EDUC=OOYRS EXP=00M0S BENEFITS- ^ SD= 

* HOURS VARIED '- ANYTIME BETWEEN 9AM TO 1 AM. SALARY IS START 

* ING ONLY. WILL GET RAISES. FOOD AT T/2 COST. WILL START PA 

* RT TIME. 
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EXAMPLE A-3. 
THE JOB BANK DATA SET 



Michael L comes in looking for a job as a mechanic's 
helper. Since that is a specific category, a search on the 
DOT alone should be sufficient: 



♦READY: 

-find in jobs where-dot is 620884. 

* 01 (0.04%) RECORDS FOUND 

* 01 RECORDS IN RESULT SET 

*READYL 

-disp job desc. 

* *** JOB NUMBER 565551 *** ■ * 
*620.884 04/01/74 AUTOMOBILE MECH HELPER 40HR DUR=PERMANENT TRNE=OK 

* . REQ: UN, PHYS, 

* . ' • SIC=4911 

NO TEST REQD* L0= , 



PAY=00003.13- 



*EDUC=12YRS EXP=0OMOS BENEFITS=IN HO SL VA 



/HOUR 
PN 



SD= 



• * 
* 
* 



HOURS ARE 3:00PM TO 11:30PM, M-F. WILL ASSIST MECHANICS IN 

MAINTENANCE AND REPAIR OF. FLEET CARS, TRUCKS, AND HEAVY 
EQUIPMENT. MUST HAVE OR BE ACTIVELY WORKING TOWARDS H.S. DIP 
LOMA OR G.E.D., AS WILL LATER ENTER FORMAL MECHANIC APPREN 
TICESHIP PROGRAM. 



ERIC 
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EXAMPLE A-4. 
THE JOB BANK DATA SET 

Sandra K, an experienced auto mechanic, was recently laid off 
and is looking for a new job. Since she -is the sole support of her 
-family, she is most interested in the pay rate and would prefer a 
job that pays $3.00/hour or more. You search first on the D0T3 -f or 
auto mechanics and then for jobs paying more than $2.99/hour: 



*READY: 

-find in jobs where dot3 is 620. 

* 51 (2.16%) RECORDS FOUND 

* 51 RECORDS I^| RESULT SET 

*READY: 
-find# 

-name result mech. 



*READY : • , 

-find in mech where hrs$> 2.99. . .. % 

* 21 (41.17%) RECORDS FOUND . \. 

* 21 RECORDS IN RESULT SET 
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EXAMPLE A-4. Continued 



Then you could cross-tabulate to find out the range of 
pay/month and the number of jobs at each pay: 



*READY: ' , 

-X in result mo$. 

* 12 RECORDS IN RESULT SET- 

* 21 RECORDS REPRESENTED 



*READY: 
-p it. 
*PAY/MONTH 
520 
541 
542 
563 
606 
693 
747 
. 780 
797 
866 
953 
1191 



* 
* 
* 
* 
* 
* 
* 
* 
* 
* 
* 



COUNT' 



*END OF DATA SET • ' ' 

Since Sandra is primarily interested in a high rate of 
pay, you could now find all the jabs where the rate of pay 
is greater than $1000 and, since the number is not too large, 
display the descriptions for those jobs: 



*jREACY: 

-find in mech where mo$ > 1000. 
■ O'l (1.96%) RECORDS FOUND 
* 01 RECORDS IN RESULT SET 
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EXAMPLE A-4. Continued 



*READY: 

-disp job desc. 



* *** JOB NUMBER 570901 *f* 

*620.281 03/15/74 MECHANIC TRUCK 45HR DUR=PERMANENT TRNE=NO 

* R£Q: 

* CALL FIRST MM SIC=4212 
♦DENVER CO PAY=00275.00- . /WEEK ' NO TEST REQD L0= 
*EDUC=RW EXP=60M(JS BENEFITS= SD= ° 

J , 5 1/2 DAYS FULLY QUALIFIED JOURNEYMAN MECHANIC FOR DIESEL 

* AND GASOLINE TRUCKS OWN TOOLS APPLY IN OFFICE DO NOT ENTER 

* SHOP . . 
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EXAMPLE A-5. 
THE JOB BANK DATA SET 



Ken' J comes in looking for a part-time job for a few months 
a year (he is on Social Security). He is willing to do any kJLnd 
work. You might ask for part-time, seasonal work. 

*READY: 

-find in jobs where duration is seasonal and wkwk is partial 

* 05 (0.21%) RECORDS FOUND 

* 05 RECORDS IN RESULt SET 

The five jobs -could then be displayed. . 
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EXAMPLE A-6. 
THE JOB BANK DATA SET 

Margaret ,C is looking for a part-time job. Before a recent 
ijlness, sKe ha^been employed full time as a bookkeeper/clerk. 
You might set criteria such as a partial work week and a D0T3 
of 210: . 



*READY: 

-find 1n jobs where •dots is 210 and wkwk=partial , 

* 02 (0.08%) RECORDS FOUND 

* 02 RECORDS IN RESULT SET 



Since there are only two jobs, you can go directly to displaying 
job descriptions. 



ERIC 
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EXAMPLE A- -7. 
THE JOB BANK DATA SET 



Mildred M is interested in going bask to work full time. 
She was employed as a bookkeeper before the l>irth of her last child. 
She says that she must make at least $3.00/hour if she is to clear 
a reasonable salary after babysitting expenses, bus fare, etc. 
You might ask for bookkeeping jobs paying more -than $2.99/hour: 
» 

♦READY: 

-find in jobs where dQt3 is 210 and hr$>2.99. 

* 02 (0.10%) RECORDS FOUND 

* 02 RECORDS IN RESULT SEf . - - 
*READY: 

-disp job desc for apps. 

* *** JOB NUMBER 562742 *** ' 

*210.388 04/21/74 FULL CHARSE B00KKEEREft-40HR,-DUR=PERMANENT TRNE=NO 
♦DENVER CO PA Y=00550. 00-00600. 00 /MNTH PROF TEST REQD L0=. 

*EDUC=12YRS EXP=12M0S BENEFITS= TESTED BY E S SD= 

* 8:00-4:30 M-F ACCOUNTS PAYABLE, ACCOUNTS RECEIVABLE. GENER 
AL LEDGER THROUGH TRIAL BALANCE. NORTHEAST. MUST ALSO BE A 

* VERY PROFICIENT TYPIST. , 

* *** JOB NUMBER 567716 *** 

*21 0.388 02/25/74 FULL CHARGE BOOKKEEPER 44HR DUR=PERMANENT TRNE=NO 
*DURANGO CO PAY=00700.00- . /MNTH NO TEST REQD L0= 

*EDUC=12YRS EXP=36M0S BENEFITS= VA SD= 

* FULL CHARGE BOOKKEEPING-WILL DO MONTHLY FINANCIAL STATEMEN 

* T.HRS:8:00-5:00M-F AND 8:00-12:30 ON SAT 



* 



* 



Note: Display for APPS gives a printout the applicant can look 
at. > 
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EXAMPLE A-8. 



THE JOB BANK DATA SET 



Hartln B is a high school drop out with a sixth grade education. 
He has minimal educational skills (read-write) and a very limited 
knowledge of the job market. He is interested in a full "time job 
in Boulder. He has no previous work experience. You might ask: 



♦READY: 

-find in jobs where educ=rw and exp=0 and trne=yes and cnty*boulder 
+ and wkwk=fun. 

* 12 (O.Sn) RECORDS FOUND 

* 12 RECORDS IN RESULT, SET 
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EXAMPLE A-8. Continued 



Then you might try to give Mm a realistic picture of the 
types of jobs and levels of , pay available. 



♦READY 

-name result yep. 
*READY: - 

-find in yep where hr$> 2.O0. 

* 02 (16.66^) RECORDS FOUND 

* 02 RECORDS IN RESULT SET" 

♦READY: 

-disp job desc. 

* *** JOB NUMBER 537960 *** ' 

*599.885- 04/04/74 TIRE RECAPPER 44HR DUR=PERMANENT TRNE=OK 

* • * REQ: 

* SI 0=7534 
*L0N6M0NT CO PAY=00002.50- . /HOUR NO TEST REQD 
*EDUC=RW EXP=O0MOS BENEFITS= ' • 

* TEND MACHINES THAT RECAP AND RETREAD TIRES FOR REUSE. WILL 

* ACCEPT TRAINEE. M-F 8 AM TO 5 PM. SATS .8 AM TO 12 *NbON. TI 

* ME & 1/2 OVER 40 HOURS. 18+. * , 

* *** JOB NUMBER 538004 *** 

*739.887 03/13/74 - ASSEMBLER OIL FILTER ,,,40HR DUR=PERMANENT ■TRNE=OK 

* -5 -^REQ: UN, PHYS, 

* . ■ ■ , MIT SIC=35.99 

* . ^AY=00002.38- . /HOUR NO TEST REQD 
*EDUC=RW EXP=O0MO^ENEFITS= 

* VARiaUS ASSEMBLY LINE WORK IN PLANT MANUFACTURING OIL AND 

* AIR FILTERS*F0R AUTOMOBILES. TRACTORS & TRUCKS. 

* M-F 4:15 PM - 12:45 AM (MANDATORY) 
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EXAMPLE A-9 



KEY WORDS IN THE JOB DATA SET 



Margaret Teacher comes in and requests a job as an English 
teacher. Since there is not a separate DOT for English Teacher, 
you might use a key word for searching, 

*READY: 

-St for engl , 

The above command scans all job titles for worcjjp containing Engl, 
An alternative might be: 



The above command scans the job description for the word containing 
Engl. This could, of course, retrieve words such as England as wel 
and retrieve occupations requiring English. To avoid this, an 
initial screening cpuld be done to find jobs for secondary school 
teachers, followed by the SD command: 

-find in jobs where dot3=sd for engl. 



*READY: 

-sd for engl . 



N 




104 



111 



DOCUMENTATION A-2. APPLICANT FILE DESCRIPTION 
THE APPLICANT DATA SET 



APPLICANT DATA' PILE DESCRIPTION 
.USE COUNT! 1 



F(#) FIELD. NAME 



ABBR 



VALUE DE SCR I PT I (JN 



F(l) SOCSECNUM SSN 
F(2) NAME/ NAME 
F(3) BIRTHDATE BRTH 



F(4) APPTYPE TYPE 
CATEGORIES 
NOREPLY 
REGISTERED 
PART. REG 
RENErlAL 

F(3) SUMMER SUM 
CATEGORIES 
NOREPLY 
YES 
, NO 

F(6) SEX % " SEX 
CATEGORIES 
NOREPLY 
MALE 
FEMALE 

F(V) EDUCATION* £DUC 
CATEGORIES 
NONE 
FIRST 
SECOND 
' THIRD 
FOURTH 
FIFTH 
. SIXTH 
SEVENTH 
EIGHTH ' 
NINTH 
TENTH 
ELE VENTH 
HIGHSCHOOL 
COLLEGE 1 
.C0LLeGE2 
a)LLEGE3 
BACHELORS ' 
MASTERS 
MASTERS* 

PHD ' 

F(8) D0T\T06 DOT 



APPLICANT'S SOCIAL SECURITY NUMBER 
APPLICANTS NAME 

DATE OF BIRTH YYMM,IF MM =00 THEN 
MONTH OF BIRTH IS UNKNOWN 

APPLICANT TYPE 

0 NO REPLY 

1 REGISTERED ^ . 

2 PARTIALLY REGISTERED 

3 RENEWAL APPLICATION 

SUMMER YOUTH 
0 NO REPLY 
2 NO 

SEX OF APPLICANT 

0 NO REPLY 

1 MALE 

2 FEMALE ' • 

HIGHEST GRADE OF SCHOOL COMPLETED 

' 0 NONE 

I FI-RST GRADfe 

" 2 SECOND GRADE 

3 THIRD 

4 FOURTH GRADE 

5 FIFTH GRADE 

6 SIXTH GRADE 

7 SEVENTH GRADE ' 

8 EIGHTH GRADE 

9 NINTH GRADE , 

10 TENTH GRADE 

1 1 ' ELEVENTH Gt^ADE 

12 HIGH SCH(X)L GRADUATE OR G.E.t), 

13 ONE YEAR OF OTUEGE 

14 TWO VEARS OF COLLEGE 

15 THREE YEARS OF COLLEGE 

16 COLLEGE GRADUATE 
1 7 MASTERS DEGREE 

18 POST-MASTERS GRADUATE WORK (BUT 
^ . NOT A PH.D.) 

19 PH.D. DBGliBE OR EQUIVALENT 

ALL SIX, DIGITS OF APPLICANT'S DOT 
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DOCUMENTATION A- 2:. Continued 



APPtlCANT DATA FILE DESCRIPTION 

(CONTINUED) 



F{#) FIELD NAME 



ABBR 



VALUE DESCRIPTION 



F(9) DOTITOI ^ DOTl 

F{IO) D0TIT02 1K)T2 

F(ll) DOTIT03 D0T3 

F(12) D()T4T06 DPT 

F{J3) DATA DATA 

Fl\4') PEOPLE PEOP 

F()5) THINGS THNG 

F(J6) DOTSUFFIX SUF 

F(I7) APPDATE DATE- 
CATEGORIES 
^NOREPLX 

FUS) ETHMIC' RACE 
CATEGORIES 
NOREPLr 
WHITE 
NEGRO 
AMERIND 
ORIENTAL 
' OTHER 
INA 

F(19) SPAi^ISH SPAN 
CATEGORIES 
NOREPLr 
MEXICAN 
PUERTORICAN 
OTHER 
NO 

F(20) VETERAN VET 
CATEGORIES 
NONVETERAN 
RS 
RSD 
RSS 

VIETNAM 



CODE 

K FIRST DIGIT OF APPLICANT-' S DOT 
CODE 

FIRST TWO DIGITS OF APPLICANT'S 
DOT CODE 

FIRST 3 DIGITS OF APPLICANT-'S 
D.O.T. CODE 

UST 3 DIGITS OF APPLICANT-'S 
D.O.T, CODE , / 

FORTH DIGIT OF DOT CODE (DATA) ^ / 

FIFTH DIGIT OF DOT CODE (PEOPLE) 

SIXTH DIGIT OF DOT .CODE (THINGS) 

DOT SUFFIX 

DATE OF APPLICATION (YMMDD) * ^ " 
0 NO REPLY 

ETHNIC GROUP 

'/ * 

0 ^ NO REPLY , /• 

1 WHITE 

2 NEGRO 

3 AMERICAN INDIAN 

4 ORIENTAL 

5 OTHER 

'6 INFORMATION NOT \VAILABLE 

*• 

APPLICANT HAS SPANISH SURNAME 

0 NO REPLY ^ ■ 

1 MEXICAN 

2 PUERTO RICAN 

3 OTHER SPANISH 

4 NO SPANISH SURNAME 

VETERAN STATUS , 

0 NON-VETERAN 

1 RECENTLY SEPERATED 

2 RECENTLY SEPARATED DISABLED VET 

3 RECENTLY SEPARATED SPECIAL 

DISABLED VET 

4 VIETNAM ERA VETERAN 



107 

113' 



DOCUMENTATION- A-2 • Continued 



ICANT DATA FILE DESCRIPTION 

(CONTINUED) ' 



F(#) FIELD NAME 



ABBR 



VALUE DESCRIPTION 



CATEGORIES (CONTINUED) 
VED 
VES 

OTHER VET 
OVD 
OVS ' 

F(2I) HANDICAPS, HDCP 

CATEGORIES " * 

NONE- 
ORTHO 
VHS 
LEGAL 
' NEUROPSr 
EPILEPSr 
ALa)H()L 
DRUGS 
MR . 
OTHER 

F(22) WELFARE rtELF 
CATEGORIES 
NOREPLy 
WIN VOL ' ^ 
WINVOLCEPT . . 
WINREO 

WINREQCERT ' 
.OTHER 
NONE 
OTHER 

NONE • * - 



F(23) POOR 



'POOR 



j:ui 



CATECORiES 
NOREPLY 
DI5ADV 
OTHERPOOR 
OTHER 

F(24) CUIMANT 

CATEGORIES 
NOREPLY 
STATE 
UCX 
TEA 

UCXI3^ ' 
N9 

F(25) FOODSTAMP F(X)D' 



5 
6 
7 
8 
9 



0 
I 

2 
3 
4 
5 
6 
7 
8 
9 



0 
I 

2 

3^ 

4 

5 
6 
7 
8 



0 
I 

2 
3 



0 
I 

2 
3 
4 
5 



VIETNAM ERA VET DISABLED 

VIETNAM ERA VETtSPECIAL DISABLED 

OTHER VETERAN 

OTHER VETHRANS DISABLED 

OT-HE VETERANS SPECIAL DISABLED 

APPLICANT'S MOST SIGNIFICANT 
HANDICAP, IF ANY 

NO Handicaps 

ORTHOPEDIC HANDICAP 

VISION, HEARING OR SPEECH HANDICAP 

LEGAL OFFENDER 

NEUROPSYCttiATRIC HANDICAP 

EPILEPSY 

ALa)H()LISM 

DRUG ADDICTION 

MENTAL RETARDATION HANDICAP 

ANY OTHER HANDICAP 

APPLICANT'^ WELFARE STATUS 

NO REPLY , • . * 

hIN VOLUNTARY REGISTRANT- 
-WIN VOLUNTEER (CERTIFIED) / 
hIN REQUIRED (MANDATORY / 
REGISTRANT) ' / 

WIN REQUIRED CERTIFIED / 
OTHER WELFARE / 
NO WELFARE / 
OTHER WELFARE FROM OLD ESARS 
NO WELFARE FR()M OLD ESARS 

FAMILY INCOME CLASSIFICATION 
ACCORDING TO P()VERTY GUIDELINES, 

NO REPLY j 

DISADVANTAGED 

OTHER POOR 

OTHER (NON-DISADVANTAGED) j 

APPLICANT'S CLAIMANT STAT^JS 

NO REPLY i 
' STATE I 
UCX* UCFE, OR DUA 
TEA ^ 
UCX BENEFITS FOR 13 OR MORE WEEKS 
NO f 

FOOD STAMP APPLICANT \ 
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DOCUMENTATION A-2. Continued 

APPLICANT DATA FILE DESCRIPTION 

(CO^ITINUED) 



F(#) FIELD NAME 



A6BR 



Value description 



CATEGORIES 
NOREPLY 
YES 
NO 

F(26) TRANSPORTATION TRAN 
CATEGORIES . 
UNKNOhN 
NO 
YES 

F(27) DRIVERSLICENSE DLIC 

CATEGORIES 
NONE 
AUTO 

CHAUFFEUR . _ 

F{28) STATION/DESK S/D 

CATEGORIES 
NOREPLY 

F(29) XENTRY XNT 
CATEGORIES 
" YES 
NO 

F(30) PAY/HOUR HRS 

CATEGORIES 
NOREPLY 

F(3I) tOCATION LOG 
CATEGORIES 
EITHER 
J)ENV£R 
, iOULDER 

F(32) WORKKEEK fiKHK' 
CATEGORIES 
UNKNOWN 
FULL 
PART 

F(33) STUDENT STUD 
CATEGORIES 
UNKNOWN 
NOT 

PARTIAL 
FULL 



0' 
2 



0 
I 

2 



0 
I 

2 
3 



NO REPLY 

YES 

NO 

DOES APPLICANT HAVE TRANSPORTATION 
UNKNOWN 

NO TRANSPORTATION 
HAS TRANSPORTATION 

TYPE OF APPLICANT'S DRIVER'S 
LICENSE 

NO LICENSE 
AUTOMOBILE LICENSE 
CHAUFFEUR'S LICENSE 

STATION/DESK NUMBER OF 
INTERViEWING OTUNSELOR- 

NO REPLY 

APPLICANT X-ENTRY STATUS 

YES, APPLICANT Ha3 AN X ENTRY 
N0» THE APLICANT DOES- NOT 

MI N /mum PAY APPLICANT Wia ACCEPT 
" PER HOUR 

NO REPLY 

LOCATION rtHERRE WOftK IS DESIRED - 

NQ REPLY OR EITHER CITY - 

DENVER 

-fiOULDER 

TYPE OF WORKER FULL OR PART TIME 

. Ui>i KNOWN 
FULL TtME 
PART TIME 

STUDENT STATUS 

UNKNOWN " 
NOT A STUDENT 
PART TIME STUDENT 
FULL TIME STUDENT 



F(34) AGEGROUP 



AGE 



AGE GROUP OF ARPLICANT FROM ESARS 



109 



* 



DOCUMENTATION Continued 



APPLICANT DATA FILE DES'CRIPtlON 

(CONTINUED) 



FC#) FIELD NAME 



ABBR 



VALUE DESCRIPTION 



CATEGORIES 
NOREPLY 
UNDERGO 
20T02 1 
22T024 
26T()29 
30TC)i9 
' ^ 40T()45 
45T064 
66T064 
0VER65 

F<35) £XP£RrENCE 

CATEGORIES 
UHKNOV«N 



EXP 



0 
I 

2 
3 
4 

5 
6 
7 
8 
9 



NO REPLY 
UNDER 20 
20 TO 21 
22 TO 24 
25 TO 29 
30 TO 39 
40 TO 45 
45 TO 54 
55 TO 
OVER 



64 
65 



MONTHS OF EXPERIENCE APPLICANT HAS 
IN THE GIVEN DOT 



255 UNm)WN 



110 



IIG . 



EXAMPLE A-10. 

} > 

THE APPLICANT DATA SET 

A job comes in for a loan counselor (169.268) at a local bank. 
At least a high school education is req^uired, and the starting pay 
is $2.50/hour. To fi^d the applicants who are potential candidates 
for this job^ you might start by specifying three-digit DOT, education 
and pay: 



*READY: * _ 

'-find in apps where dot3 is 169 and educ=>12 and hr$>2.75. 

* 03 (9.67^) RECORDS FOUND 

* 03 RECORDS IN RESULT SET * 

*READY:. 

-name result loan. 



To give veterans a preference, you could specify veteran status and 
ask for a printout: 



*READY: 

-find in loan where vet is not nonveteran. 

* 02 (66.66^) RECORDS FOUND 

* 02 RECORDS IN RESULT SET 

*READY: 

-name result vet- 



Note that there is no space in nonveteran. 



'J 
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EXAMPLE A-10. Continued 



♦READY : 

-print in vet name and hr$ and xentry. 
♦NAME PAY/HOUR XENTRY 
*JONES S, ,2,35 YES 
*SMITH H 2.35 YES • 

*END OF DATA SET 



*READY : 

-find in vet where xentry=no^.- 

* 00 (0.00%) RECORDS FOUND 

* 00 RECORDS IN RESULT SET 



Since that condition cannot be met, go back* and look at all of the 
records using VET. A macro called LOOK is useful in printing infor- 
mation needed to locate the applicant form for the possible appli- 
. cant(s)*. 'To use LOOK in this example: 



♦READY: . 

-look-up all using vet. 

♦D0T1T06 NAME SOCSECNUM " VETERAN PAY/HOUR 

*1 69381 SMITH H 123456789 RS 2.35 

*1 6987.8 ^ JONES S 987654231 RSD 2.35 
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EXAMPLE A-11. 



THE APPLICANT DATA SET 



Another job has come in for a car hop (311.878) at a fast food 
chain in Boulder. The job is full time, and the hourljLpay rate is 
$1.85. You could ask: will employer ^ccept someone with no experi 



ence! 



♦READY: 

-find in apps wh^re loc is boulder and dot2 is 31 and 
+ wkwk is full and xentry=yes and hr$<=2.00. 

* 03 (9.67%) RECORDS FOUND 

* 03 RECORDS IN RESULT SET 

*READY: 

-sort in result vet and name.' 

* 03 RECORDS IN RESULT SET f 

*READY: 

-p in result name and vet. 
*NAME VETERAN 
*HART A NON VETERAN 

♦HUMPHREY H VED 
♦KENNEDY T OVD ^ 

*END OF DATA SET 

Since there are so few applicants, you can go directly to a 
display: 



♦READY:.' 

-look. 

♦D0T1T06 

*311878 

*311887 . 

*319878 



NAME 
HART A 
HUMPHREY H 
KENNEDY T 



SOCSECNUM 

ninini 

222222222 
333333333 



VETERAN 
NONVETERAN 
VED 
OVD 



PAY/HOUR^ 

2.00 
, 1.50 

1.95 
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EXAMPLE A-12. 
THE APPLICANT DATA SET 

You have received a job opening for a swimming instructor 
(153.228). The job is just for the summer and is paj't-time. The 
job is to start on May 1, ami the applicant must be 18 as of that 
date. The pay is $1.85-2,00/hour for an inexperienced instructor 
and $2.50-$3.00/hour for an experienced instructor. 

You might type: 



♦READY: 

-find in apps where dot3=153 and summer=yes and wkwk=part 
+ and birthdate<=5605. c 

* 05 (16.12%) RECORDS FOUND ' 

* 05 RECORDS IN RESULT SET 

♦READY: 

=name result jock. c. 
*REAOY: 

-find in jock where xentry=no and hr$<=3.00 
+ also where xentry=yes and hr$<=2.10. 

* 03 (60.00%) RECORDS FOUND 

* 03 RECORDS IN RESULT SET 

*READY: 

-p in result name and xentr^.and hr$ and vet. 



*NAME 
*FISH A 
*GOLDA FISH 
*MER MAID 



XENTRY 
NO 
NO 
YES 



PAY/HOUR 
2.15 
2.00 
1.95 



*END OF DATA SET 



VETERAN 
NONVETERAN 
OTHERVET 
RSS 



*READY: 

-find in result where name='GOLDA FISH' also where name='MER MAID' 

* 02 (66.66%) RECORDS FOUND 

* 02 RECORDS IN RESULT SET 



♦READY: 
-look. 
*D0T1 T06 
*1 53884 
*1 53878 



NAME 

MER MAID 
GOLDA FISH 



SOCSECNUM 
124842100 
900000009 



VETERAN 
RSS 

OTHERVET 



PAY/HOUR 
1.95 
2.00 
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EXAMPLE A-13. 
THE APPLICANT DATA SET - 

A job comes in for a night watchman (372.868). The education 
requirements are minimal (read/write) . It is required that the 
applicant have a driver's license.. The pay is $1.85/hour, rnd the 
relationship with people is speaking-signaling. 

The DOT digits 4, 5, and 6 refer to the job's requirements 
of skills in dealing with data, people, and things. The field 
PEOPLE refers to skills in dealing with people, and the digit 6 
refers to speaking-signaling* You might start by typing: 



*lfEADY: 

-find in apps where educ>=3 and dlic=auto and people=6 
+ and hr$=<1.85 and dot3=372. 

* 06 (19.35%) RECORDS FOUND 

* 06 RECORDS IN RESULT SET 



*READY: 

-sort in result vet. 
' *' 06 RECORDS IN RESULT SET 



*READY: 

-p in result name and educ and hr$ and vet. ^ 



*NAME 
*FRICK W 
*BR0NSON C 
*RUMELHART 
*COHEN N, 
*KAHN N 
♦HARRIS R 



EDUCATION 

SEVENTH 

COLLEGEl 

TENTH 

THIRD 

HIGHSCHOOL 
FIFTH 



PAY/HOUR 
1.5^ 
1.40 
1.40 
1.80 
1.75 
1.85 



VETERAN 
NONVETERAN 
NONVETERAN 
RS 

VIETNAM 

VED 

VES 



*END OF DATA SET 




EXAMPLE A- 14 . 
THE APPLICANT DATA SET 

A job opening is received for a con^uter programmer (020.188). 
The starting pay is $800-- $1,000 /month, at least a bachelor's degree 
is required. The job is full time; an Experienced person is 
preferred, but not required. You might type: 



*READY: 

-find in apps where dot3 is 020 and hr$>=4.69 and 
+ educ>=bachelors and wkwk=fun. 

* 05^ (16J2%) RECORDS FOUND 

* 05 RECORDS IN RESULT SET 



♦READY:.. * 



•name result pro. 



♦READY: 

-sort in pro vet. 

* 05 RECORDS IN RESULT SET 



*READY: . ^ 

-p in pro name and educ and hr$ and xentry and vet. 



*NAME 


EDUCATION 


PAY/HOUR 


XENTRY ■ 


• VETERAN 


*FORD J 


. MASTERS 


5.20- 


YES 


VED 


*TRUMAN H 


PHD 


7.83 


fiO 


NONVETERAN 


*HOOVER H 


MASTERS+ 


7.00 


NO 


RS 


♦KENNEDY J 


MASTERS+ 


7>50 


Y^S 


NONVETERAN 


♦NIXON R 


BACHELORS 


5.75 


YES 


RS 



♦END OF DATA S^T 
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EXMPLE A-14". ContfSuea 



*^EAby: 

-find in result where t\r$<=5.93 and xentry=no. 

* 01 (20.00%) RECORDS POUND 

* 01 RECORDS IN RESULToSET , 



*READY: 
-look up all. 
*DOT1T06 . 
*020878 FORD J 



MAMC 



SOCSECNUM 
100000000 



VETERAN 
VED 



PAY/HOUR ■ 
5.20 - • 



EXAMPLE A-15. - 

c 

7" . THE APPLICANT DATA SET 

^ MICRO, however, cannot find applicants who are not there! 
Suppose, for e'xample, a^jofa has come In for a strip-tease artist. 
You coald ask: ^ . . - 



*READY.: 

-find?in apps" where dot=159848. 

* 00 (0.00%) RECORDS FOUND 

* 00 RECORDS IN RESULT SET- 



You will note, there are no takers, 



0 • 
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EXAMPLE A-16, _ 
THE APPLICANT DATA SET 



A job comes in for an experienced headwaiter at^a restaurant 
between Boulder and Denver, It Is a tull-tlme, year-round job 
requiring a high school education and paying $2,50/hour. You 
might type: 



♦READY; 

-find in apps where dot3=350 and xentry=no and wkwk=fun 
+ and suniner=no and hr$<=2,50, 

* 03 (9.67%) RECORDS FOUND . ' 

* 03 RECORDS IN RESULT SET 

♦READY: 

-name result hw. .... 
♦READY: 

-sort in hw vet. * ~ . 

* 03 RECORDS IN RESULT SET , ; 

♦READY: . . 

-p in result name and hr$ and vet. 
♦NAME PAY/HOUR VETERAN 

♦COOK ABE 1.75 NONVETERAN 

♦FOOT BOB 2.50 NONVETERAN 

♦KID BILL 2.10 RS 

♦END_^OF DATA SET 

♦READY: 

-find in result where vet Is not nonvcteran and hr$<2.00. 

* Ql (33.332) RECORDS FOUND 

* 01 RECORDS IN RESULT SET 



♦READY: 
-look. 
♦DOT1T06 
♦350887 



NAME 

KID BILL 



SOCSECNUM 
640000000 



VETERAN 
RS 



PAY/HOUR 
2.10 
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EXAMPLE A-17. 
THE APPLICANTn DATA SET 

MICRO can also be used to find hard-to-place applicants for jobs for 
which they might be qualified. For example, a job comes in for a 
camera repairjnan. The earner a» shop is willing to train someone with 
a natural aptitude for this kind of work. (Data/People/Things-Code 281). 
The starting pay/is $2.50/hour, and the work is sedentary, so .the 
employer would accept a handicapped applicant. You type: 



*READY: ' " 

-find In apps where handicaps=ortho and dot4=281 and hp$«2:50 

* 03 (9.67%) RECORDS FOUND 

* 03 RECORDS IN RESULT SET 



♦READY: 

-name result kodak. 



*READY: 

-sort in kodak vet. 

* 03 RECORDS IN RESULT SET 



♦READY: 

-p in .result -name and vet. 
*NAME , * VETERAN 

♦PICTURE A NONVETERAN 
*FILM A • RS 
*FLASH A V£S 

.,*END OF DATA SET ^ 
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APPENDIX B . 
Referral Status File Description 
Used in Analysis in Chapter 3 
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-pa e UME I h^T-I-Cm—B-r-l-^ 



REFERRAL STATUS fiLE DESCRIPTION 



REFERRAL DATA FILE 
USt: COUNT* 



FIELD HAME 



AB8R 



VALUH DESCRIPTION 



F(l)^ KEY 

F(2) . ORDERDESK 

P(J ) INDUSTRY 



F(4) DURATION 

CATEGORIES 
PERMANENT 
DAYSIT03 
^ DAYS4T0150 
' SEASONAL 

F(5) HOURS ' 

CnTECOR lES 
NOT-APPL 

F(6) WORKWEEK 

CATEGORIES 
FULL 
PART 

F</) EDUCATION 

CATEGORIES 
NOT-APPLIC 
RW ♦ 
' " FIRST 

^ SECOND . 
THIRD 
FORTH 
F I FTH 
srAin 
SEVENTH 
^ EIGHT 
NIWTH 
TENTH 
ELEVENTH 
HIGH 
COLLEGE I 
C0LLEGE2 
COLLEGES 
BACHELOR 
MASTER 
• DOCTORATE 

F(8) EXPERIENCE- 



F(9) . TRAINEE 



K 

ODSK 
SIC 

DURA 



HRS 



WKWK 



EDUC 



EXP 
TRNE 



STATION DhSK OF ORDER TAKER 

STANDARD INDUSTRIAL CLASSIFICATION 
NUMBER 

DURATION OF JOB 

! PERMANENT 

2 1-3 DAYS 

3 ^4-150 DAYS . 

4 SEASONAL 

HOURS rtORKED PER rtEEK 

0 NOT APPLICABLE 

WORK WEEK J FULL OR PART 

' 1 FULL TIME , 
2 FART TIME 

EDUCATION . ^ 

0 NOT APPLICABLE 

^0 READ AUD nR ITE ONLY 

I- FIRST GRADE 

2 StCONa GRADE 

3 THIRD dRADE 

4 FORTH GRADE 

5 FIFTH GRADE 

6 SIXTH GRADE - 

7 SEVENTH GRADE 

8 EIGHTH GRADE 

9 NINTH GRADE 
10 TENTH GRADE 

1 I LLEVEvlTH GRADE 

12 HIGH SCH(X)L EDUCATION 

13 FIRST YEAR COLLEGE 

14 SECO»>iD YEAR COLLEGE 

15 THIRD YEAR COLLEGE 

16 BACHELOR DEGREE 
I / MASTERS, DEGREE 
19 DOCTORATE 

NUMBER OF MONTHS OF EXPIIJ? ICriCE 
REQUIRED 

hILL EMPLOYER ACCEPT A TRAINEE? 
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DOCUMENTATION B-l. Continued 



EftRAL DATA FILE 



(COffTINUED) 



F(#) 

> 


FltLD NAME 


ABBR 




^Ai cv^wn ICO 






YES 




> 


' NO 




F(IO) 


EMi^LOYER-NAME 


FIRM 


Fi\}) 


EMP-ADDRESS 


ADDR 


F( 12) 


CITY 


CITY 


F{J3) 


STATE 


ST 


F< J^) 


ZIP-CODE 


ZIP 


F(]5) 


COUNTY 


CNTY 


F( J6) 


TELEPHONE 


TELE 


F(i7) 


PAY-UNIT 


UNIT 



CATEGORIES 
HOUR 
DAY 
tiEEK 
BI-rtEEK 
MONTH 
SEAfl-MO 
YEAR 
OTHER 

F(I8) MIN-PAY MINS 
CATEGORIES 
COMMISSION 

F(!9J JOB-DOT JDI 

F(20) ' JDTITOI JDTI 

F(2J) JDflT02 JDT2 

F{22) JDTITOJ JDia 

F(2J) JDT4T06 ' JDPT 
/ 

F(24) JDATA . , J DAT 

F(25) JPEOPLE JPEO 

F<26) JTHINGS " JTHG 



VALUE DESCRIPTION 

1 EMPLOYER »1ILL ACCEPT A TRAINEE 

2 EMPLOYER >^ILL NOT ACCEPT A TRAINEE 

EMPLOYER'S NAME 
EMPLOYER-^ S ADDRESS 
CITY OF EMPLOYER 
STATE OB 'EMPLOYER 
EMPLOYER^'S ZIP CODEv 
COUNTY OF EMPLOYER 

« 

EMPLOYER'S TELEPHONE NUMBER 
PAY PERIOD UNIT 

1 H6uftLY 

2 PAID BY THE DAY 

3 PAID BY THE. WEEK 

4 PAID BI-WEEKLY 

5 PAID MONTHLY 

6 PAID .StM I -MONTHLY 

7 PA ID YEARLIV 

8. OTHER 'TsUCH AS COMMISSION) 

MINIMUM PAY Of JOB 
0 PAY ON COMMISSION BASIS 

JOB OCCUPATION CODE ^ 

OCCUPATION CODE - FIRST DIGIT ONLY 

.OCCUPATION CODE - DOT 1ST AND 2ND 
DIGITS 



OCCUPATION^ CODE 
3RD 



DOT 1ST THROUGH 



OCCUPATION CODE - DOT 4TH THROUGTH 
6TH DIGITS (DATA^-PtOPLE-THINGS) 

OCCUPATION CODE - DOT 4TH DIGIT 
( DATA ) 

OCCUPATION CODE - DOT 5TH DIGIT 
(PEOPLE) 

OCCUPATION CODE - DOT 6TH DIGIT 



ERIC 
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DOCUMENTATION B- J Continued 
REFERRAL DATA FILE 







(a)NTINUED) 






FIELD NAME 


ABBR 


VALUE DESCRIPTION 








(THINGS) 


F(2 /) 


. JOBORDERNUM 


J06# 


JOB ORDER NUMBER 


FC28) 


SS-NUM 


SSNO 


SOCIAL SECURITY NUMBER 


F(29) 


APP--NAME 


NAM.E 


APPLICANT'S NAME 


F(30) 


APR -DOT 


ADF 


APPLICANT'S OCCUPATION CODE 


F(J"I ) 


aDtjtoj 


ADTI 


f IRST DIGIT OF APPLICANT'S DOT 
CODE 


F(32) 


ADTITOS 


ADT2 


FIRST TWO DIGITS OF APPLICANT^^S 
DOT CODE 


F(33} 


ADr 1 T03 


Acrr3 


FIRST J DIGITS OF APPLICANT'S 
D.O.T. CODE 


F(34) 


ADr4T06 


AOPT 


LAST 3 DIGITS OF APPLICANT'S 
D.O.T. CODE 


F(35) 


ADATA 


ADAT 


FORTH DIGIT OF DOT CODE (DATA) 


F(36) 


APEOPLE 


APED 


FIRH DIGIT OF DOT CODE (PEOPLE) 


F(37) 


ATHINGS 


ATHG 


SIXTH DIGIT OF DOT^ CODE (THINGS) 


F(38) 


BIRTH-YR 


BRTH 


. YEAR ()F-BIR:TH 


F(39) 


SEX 

CATEGORIES 
• MALE 
FEMALE 


SEX 


SEX OF. APPLICANT 

.1 MALE 
2 FEMALE 


F(40) 

> 


ETHNIC 

CATEGORIES 
WHITE 
NEGRO 
AM,-INDIAN 
ORIENTAL 
OTHER 
INA 


ETHN 

• 


APPLICANT'S ETHNIC GROUP 

1 WHJTE 

2 NEGRO 

3 AMERICAN INDIAN 

4 OR I ENTAL 

5 (jTHER 

6 INFO NOT AVAILABLE, PROHIBITED BY 

STATE LAW, OR CANNOT BE 
ASCERTAINED ' 


F(4n 


SPAN-SURNAj6(E 
CATEGORIES" 
YES 
NO 


SPAN 


SPANISH SURNAME 

1 APPLICANTS SURNAME IS SPANISH 

2 APPLICANTS SURNAME IS NOT SPANISH 


F(42) 


FAM-INCM 


INCM 


APPLICANT'^S FAMILY INCOME LEVEL 



125 



130 



DOCUMENTATION B-I. Continue.d 



REFERRAL DATA FILE 



FIELD NAME 



(COWriNUED) 



A6BR 



VALUE DESCRIPTION 



CATEGORIES 
DISADVANTAG 
POOR 
POVERTY 
OTHER 

F(43) VETERAN VET 
CATEGORIES 

NON-VET 

SEPARATED 
^ OTHER 

F(44) APP--EDUC APED 

F(45) HANDICAPPED HDCP 
CATEGORIES 
YES 
NO 

P(46) PLACEMENT-DATE PLOT 

F(4/) REFERRALDATE DATE 

F(48) SOURCE SORC 
CATEGORIES I 
WALK--IN ' 
LETTER ^ 
TELEPHONE 
INTRANSTATE 
INTER-STATE 

F(49) CLAIMANT CLA 



CATEGORIES 
YES 
NO 

F(50) LOCAL-OFFICE 



F(5I) SEARCH-METHOD 
CATEGORIES 
JOBDEV 
rtALK-lN 
JlS-rtI 
FICHE-WI 
CALL-IN 

TERM-WIiJIS^ 

TERM-hI«APP 

^ TERM-WlJJOB 



LOFF 
METH 



DISADVANTAGED ( 
OTHER POOR 
NEAR POVERTY 
OTHER 

VETERAN STATUS^ 
NON-VET 

RECENTLY SEPARATED 
OTHER VET 

4 

NUMBER OF HIGHEST GRADE COMPLETED 

IS APPLICANT HANDICAPPED 

YES, APPLICANT IS HANDICAPPED 
NO, APPLICANT IS NOT HANDICAPPED 

DATE OF PLACEMENTM)F APPLICANT 

DATE OF REFERRAL 

SOURCE OF REFERRAL 

WALK-IN 

LETTER OR CALL-IN CARD 
TELEPHONE 

INTRA-STATE REFERRAL 
K INTER-STATE REFERRAL 

IS APPLICANT AN UfiEMPLOYMENT 
INSURANCE CUIMANt? 

YES 
NO 

LOCAL OFFICE NUMBER . 

METHOD OF JOB (APPLICANT) SEARCH 



0 JOB Dt^VELOPMENT 

1 frALK-INl NO FICHE OR COMPUTER USED 

2 ftALK-IN? USED JIS FICHE ONLY 

3 hALK-INl INTERVIEWER, USED FICHE 

4 CALL-IN AS A RESULT OF MANUAL - 

APPLICANT SEARCH 

5 hALK-lN; USED JIS TERMINAL OUTPUT 

ONLY 

6 ^MK-lm INTERVIEWER DID APPLICANT 

SEARCH ON TERMINAL o 

7 WALK-IN I INTERVIEWER DID JOB 



J 

2 
3 
4 
5 
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DOCUMENTATION Continued 



REFERRAL DATA FILE 



'(CONTINUED) 



R#) FIELD NAME 



ABBR 



VALUE DESCRIPTION 



CATEGORIES (CONTINUED) 
TERXh-CKAPP 
TERM-CI»JPB 

F(52) REFER-DESK RDSK 



F(5i) NOT-QUALIFIED NO 
CATEGORIES 

QUALIFIED - Q 

NOTQ NOTO 

F(54) RESULTS TiSLT 
CATEGORIES 
HIRED 
REFUSE-JOB 
NO- INTER ' ^ 

NO-SHOW 
JOB-FIIiED 
NOT-QUAL 
FAILED-PHYS 
FAILED-TEST 
ANOTHER 
NO-CALL- IN 
REFUSE-REF 

F(55) HIRE ' HIRE 
CATEGOPIES 

NOT-HIRED NH 

HIRED H 



8 
9 



0 



] 

2 

3 

4 

5 

6 

7- 

8 

9 
10 
1 J . 



0 
\ 



SEARCH ON TERMINAL 
CALL-hN AS A RESULT OF APPLICANT 

SEARCH ON TERMINAL 
CALL-IN AS A RESULT OF JOB SEARCH 

ON TERMINAL 

STATION DESK OF PERSON MAKING 
REFERRAL 

NOT QUALIFIED ON REFERRAL. 

QUALihiED 
NOT QUALIFIED 

RESULT OF REFERRAL ' - 

HIRED 

refused job ^ 
failed to report for interview 
failed to report to .work 
job filled • 
not qualified 
failed physical 
failed employer test 
took another referral 
failed to respond to call-in 
refused referral 

hire' 

not hired 

HIRED 
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ippNDIX : C 

s Used in Chapter 
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TABLE C-1. REGRESSION RELATING TENURE 



ON JOB TO SiailFICANT VARIABLES AND SEARCH METHODS 
(See Chapter 3) ' 

ANALYSIS OF VARIANCE OF DIF N= 431 



SOURCE 

REGRESSION 
ERROR , 
TOTAL 



SUM OF SQRS MEAN SQUARE F-STATISTIC SIQJIF 

10.974 .0000 



6 
424 
430 



.16965 +6 
.10924 +7 
.12621 +7 



28274. 
2576.5 



MULTIPLE R= 


. 36663 R-SQR= 


= .13442 SE= 


50.759 






VARIABLE 


PARTIAL 


COEFFICIENT 


STD ERROR 


T-STATISTic 


SIGNIF 


CONSTANT 




11.375 


8.2531 


1.3783 


.1688 


HIdHSCH 


.20171 


22. 207 


5. 2366 


4.2407 


.0000 


WAGE 


.24972 


15.867 


2.9879 - 


5.3102 


.0000 


EOFICHE 


-.09007 


-12.249 


6.5779 


-1.8621 


.0633 


MANAPSER • 


.04575 


6.9491 , • 


7.3683 


.94311 


.3462 


CAS 


.08323 


19.110 


11.111 


1.7199 


.0862 


CJS 


.01218 


3.8220 


15.242 


.25074 


.8021 



Where I 

HIGHSCH = 1 if job requires a high school education 

< « 0 Qtherwise 
WAGE - hourly rate^of job in dollars 

The remaining variables measure the difference between 
average tenure of a particular placement method and 
self-^service. ^ . ' 

'eOFICHE^s Employment officer uses fiche 
MANAPSER - Manual Applicant Search 
CAS - Computer Applicant Search 
CJS ~ Computer Job Search 
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TABLE C-2. REGRESSION RELATING TENUI^ 
ON JOB TO ALL VARIABLES 0%POSSlBLE INTEREST ' 



ANALYSIS OF VARIANCE OF DIF N= 429 

SOURCE DF SUM OF SQRS MEAN SQUARE F-STATISTIC SIGNIF 



REGRESSION 


11 


.16907 +6 


15370. 


5.8968 




.0000 


ERROR- 


41-7 


.10869 +7 


2606.5 








TOTAL 


,428 


.12560 +7 










MULTIPLE R= 


.36689 R-SQR= 


= .13461 SE= 


51.054 • 








VARIABLE 


PARTIAL 


COEFFICIENT 


STD ERROR 


T-STATISTIC SIGNIF 


CONSTANT 


. 19°363 


7.2042 


17.805 


.40461 




.6860 


HIGHSCH 


22.042 


5.4690. 


4.0304 




..0001 


WAGE 


.22787 


15.234 


3.1876 


4.7790 




.0000 


EOFICHE 


-.08386 


-11.971 


6.9658 


-1. 7185, 




.0864 


MANAPSER 


.04132 


6=6976 


7.9305 


.84454 




.3989 


CAS 


.08303 


19,227 


11.301 


1.7014 




.0896 


CJS 


.01459 . 


4.5751 


15.355 


.29795 




.7659 


EXP 


.01579 


1.6922 


5.2467 


.32253 




.7472 


VET 


.00555 


.71495 


6.3100' 


. 11330 




.9098 


NONWHITE 


.04020 


10.417 


12.679 


.82158 




.4118 


SPANISH 


.01783 


3.5635 


9.7871 ^ 


.36410 




.71-60 


APED 


.01316 


.33272 


1.2384 


.26867 




.7883 



"1 

Where: 

\ 

EXP ~ ^ if job requires experience 
VET = ^ if' applicant is a ^^eteran^ 
NON'WHITE - 1 if applicaift is nonwhite 

SPANISH = i if applicant has Spanish surname 

< 

APED - applicants grade of education completed 
Other variables - see Table C'-l 
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TABLE C-3. REGRESSION RELATING TENURE 



ON JOB TO VARIABLES INCLUDING OCCUPATION OF JOB 



LEAST SQUARES REGRESSION 

ANALYSIS 0^ VARIANCE OF DIF N= 431 • 

SOURCE DF SUM OF SQRS MEAN SQUARE F-STATISTIC SIGNIF 

9.0908 -.0000 



REGRESSION 
ERROR 
TOTAL. 



10 
420, 
430 



.22456 +6 
.10375 +7 
.12621 +7 



22456 
2470.2 



MULTIPLE R= .42182 R-SQR= .17793 SE= 49.702 



VARIABLE 


PARTIAL 


COEFFICIENT 


STD ERROR 


T-STATISTIC 


SIGNIF 


CONSTANT 




12.065 - 


8.1336 


1.4833 


.1387 


HIGHSCH 


.08527 


10.957 


6.2473 


1.7539 


.0802 


WAGE 


, 122124 


13.899 


2.9896 


4.6492 


.0000. 


EOFICH 


-.10983 


-15.973 


7.0531 


-2.2646 


.0240 


MANAPSER . 


.01164 


1.8169 


7.6164 


.23855 ,„„ 


' -.8116. 


CAS 


.06013 


13.529 


10.958 


1.2346 


.2177 


cjs:^^ 


-.00369 


-1.1373 


15.043 


-.75605 il 


.9398 


PROF 


.11373 


35.335 , 


15.062 


• 2.3460 


.0194 


CLERSALE 


.17428 


■ 29.915 


8.2475 


3.6272 


.0003 


FARMING 


.10028 


43f.l28 


20.880 


2.0655 


.0395 


BNCHWK 


.12391 


17.149 - 


6.7013 


2.5591 


.0108 



Where : 

PROF =1 if job is 
CLERSALE =1 if job 
FARMING = 2 if jo2> 
BNCHWK ^ 1 lof job i 
Other see Table C-1 



a professi onal job 

is clerical or sales 

is agriculture or landscape 

s a. benchwork occupation 
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